Nov 14 07:58:06 user nova-compute[75305]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75305) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75305) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75305) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 07:58:06 user nova-compute[75305]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 07:58:06 user nova-compute[75305]: INFO nova.virt.driver [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 07:58:06 user nova-compute[75305]: INFO nova.compute.provider_config [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Acquiring lock "singleton_lock" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Acquired lock "singleton_lock" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Releasing lock "singleton_lock" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Full set of CONF: {{(pid=75305) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ******************************************************************************** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Configuration options gathered from: {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ================================================================================ {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] allow_resize_to_same_host      = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] arq_binding_timeout            = 300 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] backdoor_port                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] backdoor_socket                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] block_device_allocate_retries  = 300 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] block_device_allocate_retries_interval = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cert                           = self.pem {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute_monitors               = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] config_dir                     = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] config_drive_format            = iso9660 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] config_source                  = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] console_host                   = user {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] control_exchange               = nova {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cpu_allocation_ratio           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] daemon                         = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] debug                          = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] default_access_ip_network_name = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] default_availability_zone      = nova {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] default_ephemeral_format       = ext4 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] default_green_pool_size        = 1000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] default_schedule_zone          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] disk_allocation_ratio          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] enable_new_services            = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] enabled_ssl_apis               = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] flat_injected                  = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] force_config_drive             = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] force_raw_images               = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] graceful_shutdown_timeout      = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] heal_instance_info_cache_interval = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] host                           = user {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instance_build_timeout         = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instance_delete_interval       = 300 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instance_name_template         = instance-%08x {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instance_usage_audit           = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instance_usage_audit_period    = month {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] internal_service_availability_zone = internal {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] key                            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] live_migration_retry_count     = 30 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_config_append              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_dir                        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_file                       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_options                    = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_rotate_interval            = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_rotate_interval_type       = days {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] log_rotation_type              = none {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] long_rpc_timeout               = 1800 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] max_concurrent_builds          = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] max_concurrent_live_migrations = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] max_concurrent_snapshots       = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] max_local_block_devices        = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] max_logfile_count              = 30 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] max_logfile_size_mb            = 200 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] maximum_instance_delete_attempts = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] metadata_listen                = 0.0.0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] metadata_listen_port           = 8775 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] metadata_workers               = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] migrate_max_retries            = -1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] mkisofs_cmd                    = genisoimage {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] my_ip                          = 10.0.0.210 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] network_allocate_retries       = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] osapi_compute_listen_port      = 8774 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] osapi_compute_unique_server_name_scope =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] osapi_compute_workers          = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] password_length                = 12 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] periodic_enable                = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] periodic_fuzzy_delay           = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] pointer_model                  = ps2mouse {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] preallocate_images             = none {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] publish_errors                 = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] pybasedir                      = /opt/stack/nova {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ram_allocation_ratio           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rate_limit_burst               = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rate_limit_except_level        = CRITICAL {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rate_limit_interval            = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] reboot_timeout                 = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] reclaim_instance_interval      = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] record                         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] reimage_timeout_per_gb         = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] report_interval                = 120 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rescue_timeout                 = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] reserved_host_cpus             = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] reserved_host_disk_mb          = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] reserved_host_memory_mb        = 512 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] reserved_huge_pages            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] resize_confirm_window          = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] resize_fs_using_block_device   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] resume_guests_state_on_host_boot = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rpc_response_timeout           = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] run_external_periodic_tasks    = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] running_deleted_instance_action = reap {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] running_deleted_instance_timeout = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler_instance_sync_interval = 120 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_down_time              = 720 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] servicegroup_driver            = db {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] shelved_offload_time           = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] shelved_poll_interval          = 3600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] shutdown_timeout               = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] source_is_ipv6                 = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ssl_only                       = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] state_path                     = /opt/stack/data/nova {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] sync_power_state_interval      = 600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] sync_power_state_pool_size     = 1000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] syslog_log_facility            = LOG_USER {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] tempdir                        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] timeout_nbd                    = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] transport_url                  = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] update_resources_interval      = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] use_cow_images                 = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] use_eventlog                   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] use_journal                    = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] use_json                       = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] use_rootwrap_daemon            = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] use_stderr                     = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] use_syslog                     = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vcpu_pin_set                   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plugging_is_fatal          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plugging_timeout           = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] virt_mkfs                      = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] volume_usage_poll_interval     = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] watch_log_file                 = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] web                            = /usr/share/spice-html5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_concurrency.disable_process_locking = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.auth_strategy              = keystone {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.compute_link_prefix        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.dhcp_domain                = novalocal {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.enable_instance_password   = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.glance_link_prefix         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.instance_list_per_project_cells = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.list_records_by_skipping_down_cells = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.local_metadata_per_cell    = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.max_limit                  = 1000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.metadata_cache_expiration  = 15 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.neutron_default_tenant_id  = default {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.use_forwarded_for          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.use_neutron_default_nets   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.vendordata_dynamic_targets = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.vendordata_jsonfile_path   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.backend_argument         = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.config_prefix            = cache.oslo {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.dead_timeout             = 60.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.debug_cache_backend      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.enable_retry_client      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.enable_socket_keepalive  = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.enabled                  = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.expiration_time          = 600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.hashclient_retry_attempts = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_dead_retry      = 300 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_password        =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_sasl_enabled    = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.memcache_username        =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.proxies                  = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.retry_attempts           = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.retry_delay              = 0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.socket_keepalive_count   = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.socket_keepalive_idle    = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.socket_keepalive_interval = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.tls_allowed_ciphers      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.tls_cafile               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.tls_certfile             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.tls_enabled              = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cache.tls_keyfile              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.auth_section            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.auth_type               = password {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.cafile                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.certfile                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.collect_timing          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.cross_az_attach         = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.debug                   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.endpoint_template       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.http_retries            = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.insecure                = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.keyfile                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.os_region_name          = RegionOne {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.split_loggers           = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cinder.timeout                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.cpu_dedicated_set      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.cpu_shared_set         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.image_type_exclude_list = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.resource_provider_association_refresh = 300 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.shutdown_retry_interval = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] conductor.workers              = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] console.allowed_origins        = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] console.ssl_ciphers            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] console.ssl_minimum_version    = default {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] consoleauth.token_ttl          = 600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.cafile                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.certfile                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.collect_timing          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.connect_retries         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.connect_retry_delay     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.endpoint_override       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.insecure                = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.keyfile                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.max_version             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.min_version             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.region_name             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.service_name            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.service_type            = accelerator {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.split_loggers           = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.status_code_retries     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.status_code_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.timeout                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] cyborg.version                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.backend               = sqlalchemy {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.connection            = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.connection_debug      = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.connection_parameters =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.connection_recycle_time = 3600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.connection_trace      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.db_inc_retry_interval = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.db_max_retries        = 20 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.db_max_retry_interval = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.db_retry_interval     = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.max_overflow          = 50 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.max_pool_size         = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.max_retries           = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.mysql_wsrep_sync_wait = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.pool_timeout          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.retry_interval        = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.slave_connection      = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] database.sqlite_synchronous    = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.backend           = sqlalchemy {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.connection        = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.connection_debug  = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.connection_parameters =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.connection_recycle_time = 3600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.connection_trace  = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.db_inc_retry_interval = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.db_max_retries    = 20 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.db_max_retry_interval = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.db_retry_interval = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.max_overflow      = 50 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.max_pool_size     = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.max_retries       = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.pool_timeout      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.retry_interval    = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.slave_connection  = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] api_database.sqlite_synchronous = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] devices.enabled_mdev_types     = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ephemeral_storage_encryption.enabled = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.api_servers             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.cafile                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.certfile                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.collect_timing          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.connect_retries         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.connect_retry_delay     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.debug                   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.default_trusted_certificate_ids = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.enable_certificate_validation = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.enable_rbd_download     = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.endpoint_override       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.insecure                = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.keyfile                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.max_version             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.min_version             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.num_retries             = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.rbd_ceph_conf           =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.rbd_connect_timeout     = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.rbd_pool                =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.rbd_user                =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.region_name             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.service_name            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.service_type            = image {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.split_loggers           = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.status_code_retries     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.status_code_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.timeout                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.verify_glance_signatures = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] glance.version                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] guestfs.debug                  = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.config_drive_cdrom      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.config_drive_inject_password = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.enable_remotefx         = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.instances_path_share    =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.limit_cpu_features      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.use_multipath_io        = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.vswitch_name            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] mks.enabled                    = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] image_cache.manager_interval   = 2400 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] image_cache.precache_concurrency = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] image_cache.remove_unused_base_images = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] image_cache.subdirectory_name  = _base {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.api_max_retries         = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.api_retry_interval      = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.auth_section            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.auth_type               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.cafile                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.certfile                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.collect_timing          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.conductor_group         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.connect_retries         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.connect_retry_delay     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.endpoint_override       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.insecure                = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.keyfile                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.max_version             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.min_version             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.peer_list               = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.region_name             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.serial_console_state_timeout = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.service_name            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.service_type            = baremetal {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.split_loggers           = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.status_code_retries     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.status_code_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.timeout                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ironic.version                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] key_manager.fixed_key          = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.barbican_api_version  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.barbican_endpoint     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.barbican_endpoint_type = public {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.barbican_region_name  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.cafile                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.certfile              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.collect_timing        = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.insecure              = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.keyfile               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.number_of_retries     = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.retry_delay           = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.send_service_user_token = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.split_loggers         = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.timeout               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.verify_ssl            = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican.verify_ssl_path       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.auth_section = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.auth_type = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.cafile   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.certfile = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.collect_timing = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.insecure = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.keyfile  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.split_loggers = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] barbican_service_user.timeout  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.approle_role_id          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.approle_secret_id        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.cafile                   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.certfile                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.collect_timing           = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.insecure                 = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.keyfile                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.kv_mountpoint            = secret {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.kv_path                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.kv_version               = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.namespace                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.root_token_id            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.split_loggers            = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.ssl_ca_crt_file          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.timeout                  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.use_ssl                  = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.auth_section          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.auth_type             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.cafile                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.certfile              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.collect_timing        = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.connect_retries       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.connect_retry_delay   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.endpoint_override     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.insecure              = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.keyfile               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.max_version           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.min_version           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.region_name           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.service_name          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.service_type          = identity {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.split_loggers         = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.status_code_retries   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.status_code_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.timeout               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] keystone.version               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.connection_uri         =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.cpu_mode               = custom {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: WARNING oslo_config.cfg [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.cpu_power_governor_high = performance {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.cpu_power_management   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.device_detach_attempts = 8 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.device_detach_timeout  = 20 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.disk_cachemodes        = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.disk_prefix            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.enabled_perf_events    = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.file_backed_memory     = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.gid_maps               = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.hw_disk_discard        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.hw_machine_type        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.images_rbd_pool        = rbd {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.images_type            = default {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.images_volume_group    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.inject_key             = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.inject_partition       = -2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.inject_password        = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.iscsi_iface            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.iser_use_multipath     = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_downtime = 500 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_inbound_addr = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_scheme  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_timeout_action = abort {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_tunnelled = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: WARNING oslo_config.cfg [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 07:58:06 user nova-compute[75305]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 07:58:06 user nova-compute[75305]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 07:58:06 user nova-compute[75305]: and ``live_migration_inbound_addr`` respectively.
Nov 14 07:58:06 user nova-compute[75305]: ).  Its value may be silently ignored in the future.
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.live_migration_with_native_tls = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.max_queues             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.nfs_mount_options      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.num_pcie_ports         = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.pmem_namespaces        = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.quobyte_client_cfg     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rbd_secret_uuid        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rbd_user               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rescue_image_id        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rescue_kernel_id       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.rx_queue_size          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.smbfs_mount_options    =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.snapshot_compression   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.snapshot_image_format  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.sparse_logical_volumes = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.swtpm_enabled          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.swtpm_group            = tss {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.swtpm_user             = tss {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.sysinfo_serial         = unique {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.tb_cache_size          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.tx_queue_size          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.uid_maps               = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.use_virtio_for_bridges = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.virt_type              = kvm {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.volume_clear           = zero {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.volume_clear_size      = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.volume_use_multipath   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.vzstorage_cache_path   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.auth_section           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.auth_type              = password {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.cafile                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.certfile               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.collect_timing         = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.connect_retries        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.connect_retry_delay    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.default_floating_pool  = public {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.endpoint_override      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.extension_sync_interval = 600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.http_retries           = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.insecure               = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.keyfile                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.max_version            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.min_version            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.ovs_bridge             = br-int {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.physnets               = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.region_name            = RegionOne {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.service_metadata_proxy = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.service_name           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.service_type           = network {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.split_loggers          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.status_code_retries    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.status_code_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.timeout                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] neutron.version                = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] notifications.bdms_in_notifications = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] notifications.default_level    = INFO {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] notifications.notification_format = unversioned {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] notifications.notify_on_state_change = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] pci.alias                      = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] pci.device_spec                = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] pci.report_in_placement        = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.auth_section         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.auth_type            = password {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.cafile               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.certfile             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.collect_timing       = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.connect_retries      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.connect_retry_delay  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.default_domain_id    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.default_domain_name  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.domain_id            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.domain_name          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.endpoint_override    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.insecure             = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.keyfile              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.max_version          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.min_version          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.password             = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.project_domain_id    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.project_domain_name  = Default {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.project_id           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.project_name         = service {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.region_name          = RegionOne {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.service_name         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.service_type         = placement {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.split_loggers        = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.status_code_retries  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.status_code_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.system_scope         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.timeout              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.trust_id             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.user_domain_id       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.user_domain_name     = Default {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.user_id              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.username             = placement {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] placement.version              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.cores                    = 20 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.count_usage_from_placement = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.injected_file_content_bytes = 10240 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.injected_file_path_length = 255 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.injected_files           = 5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.instances                = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.key_pairs                = 100 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.metadata_items           = 128 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.ram                      = 51200 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.recheck_quota            = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.server_group_members     = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] quota.server_groups            = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rdp.enabled                    = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.image_metadata_prefilter = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.max_attempts         = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.max_placement_results = 1000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] scheduler.workers              = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.host_subset_size = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.isolated_hosts = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.isolated_images = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.pci_in_placement = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.track_instance_changes = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] metrics.required               = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] metrics.weight_multiplier      = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] metrics.weight_setting         = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] serial_console.enabled         = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] serial_console.port_range      = 10000:20000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] serial_console.serialproxy_port = 6083 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.auth_section      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.auth_type         = password {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.cafile            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.certfile          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.collect_timing    = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.insecure          = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.keyfile           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.send_service_user_token = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.split_loggers     = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] service_user.timeout           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.agent_enabled            = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.enabled                  = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.html5proxy_port          = 6082 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.image_compression        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.jpeg_compression         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.playback_compression     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.server_listen            = 127.0.0.1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.streaming_mode           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] spice.zlib_compression         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] upgrade_levels.baseapi         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] upgrade_levels.cert            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] upgrade_levels.compute         = auto {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] upgrade_levels.conductor       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] upgrade_levels.scheduler       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.cafile = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.certfile = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.insecure = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vendordata_dynamic_auth.timeout = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.api_retry_count         = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.ca_file                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.cache_prefix            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.cluster_name            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.connection_pool_size    = 10 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.console_delay_seconds   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.datastore_regex         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.host_ip                 = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.host_password           = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.host_port               = 443 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.host_username           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.insecure                = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.integration_bridge      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.maximum_objects         = 100 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.pbm_default_policy      = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.pbm_enabled             = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.pbm_wsdl_location       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.serial_port_proxy_uri   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.serial_port_service_uri = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.task_poll_interval      = 0.5 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.use_linked_clone        = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.vnc_keymap              = en-us {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.vnc_port                = 5900 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vmware.vnc_port_total          = 10000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.auth_schemes               = ['none'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.enabled                    = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.novncproxy_port            = 6080 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.vencrypt_ca_certs          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.vencrypt_client_cert       = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vnc.vencrypt_client_key        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.disable_rootwrap   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.enable_numa_live_migration = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.libvirt_disable_apic = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.client_socket_timeout     = 900 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.default_pool_size         = 1000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.keep_alive                = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.max_header_line           = 16384 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.ssl_ca_file               = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.ssl_cert_file             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.ssl_key_file              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.tcp_keepidle              = 600 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] zvm.ca_file                    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] zvm.cloud_connector_url        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] zvm.reachable_timeout          = 300 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.enforce_new_defaults = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.enforce_scope      = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.policy_default_rule = default {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.connection_string     = messaging:// {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.enabled               = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.es_doc_type           = notification {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.es_scroll_size        = 10000 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.es_scroll_time        = 2m {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.filter_error_trace    = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.hmac_keys             = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.sentinel_service_name = mymaster {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.socket_timeout        = 0.1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.trace_requests        = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler.trace_sqlalchemy      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler_jaeger.process_tags   = {} {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler_jaeger.service_name_prefix = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] profiler_otlp.service_name_prefix = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] remote_debug.host              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] remote_debug.port              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_notifications.retry = -1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.auth_section        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.auth_type           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.cafile              = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.certfile            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.collect_timing      = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.connect_retries     = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.connect_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.endpoint_id         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.endpoint_override   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.insecure            = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.keyfile             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.max_version         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.min_version         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.region_name         = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.service_name        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.service_type        = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.split_loggers       = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.status_code_retries = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.status_code_retry_delay = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.timeout             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.valid_interfaces    = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_limit.version             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_reports.file_event_handler = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] oslo_reports.log_dir           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_ovs_privileged.group  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] vif_plug_ovs_privileged.user   = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_ovs.isolate_vif         = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] os_brick.lock_path             = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] privsep_osbrick.capabilities   = [21] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] privsep_osbrick.group          = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] privsep_osbrick.helper_command = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] privsep_osbrick.user           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] nova_sys_admin.group           = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] nova_sys_admin.helper_command  = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] nova_sys_admin.user            = None {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG oslo_service.service [None req-a0c84979-eadf-46d0-b097-05ad6c66ab77 None None] ******************************************************************************** {{(pid=75305) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 07:58:06 user nova-compute[75305]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 07:58:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Connecting to libvirt: qemu:///system {{(pid=75305) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fcf5c45afe0> {{(pid=75305) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 07:58:06 user nova-compute[75305]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 07:58:06 user nova-compute[75305]: WARNING nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 07:58:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fcf5c45afe0> {{(pid=75305) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Starting native event thread {{(pid=75305) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Starting green dispatch thread {{(pid=75305) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 07:58:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Starting connection event dispatch thread {{(pid=75305) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 07:58:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Connection event '1' reason 'None'
Nov 14 07:58:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 07:58:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.mount [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Initialising _HostMountState generation 0 {{(pid=75305) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 07:58:14 user nova-compute[75305]: INFO nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host capabilities <capabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <host>
Nov 14 07:58:14 user nova-compute[75305]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 07:58:14 user nova-compute[75305]:     <cpu>
Nov 14 07:58:14 user nova-compute[75305]:       <arch>x86_64</arch>
Nov 14 07:58:14 user nova-compute[75305]:       <model>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <microcode version='1070'/>
Nov 14 07:58:14 user nova-compute[75305]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 07:58:14 user nova-compute[75305]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='osxsave'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='invtsc'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='rsba'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 07:58:14 user nova-compute[75305]:       <pages unit='KiB' size='4'/>
Nov 14 07:58:14 user nova-compute[75305]:       <pages unit='KiB' size='2048'/>
Nov 14 07:58:14 user nova-compute[75305]:     </cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <power_management>
Nov 14 07:58:14 user nova-compute[75305]:       <suspend_mem/>
Nov 14 07:58:14 user nova-compute[75305]:       <suspend_disk/>
Nov 14 07:58:14 user nova-compute[75305]:       <suspend_hybrid/>
Nov 14 07:58:14 user nova-compute[75305]:     </power_management>
Nov 14 07:58:14 user nova-compute[75305]:     <iommu support='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <migration_features>
Nov 14 07:58:14 user nova-compute[75305]:       <live/>
Nov 14 07:58:14 user nova-compute[75305]:       <uri_transports>
Nov 14 07:58:14 user nova-compute[75305]:         <uri_transport>tcp</uri_transport>
Nov 14 07:58:14 user nova-compute[75305]:         <uri_transport>rdma</uri_transport>
Nov 14 07:58:14 user nova-compute[75305]:       </uri_transports>
Nov 14 07:58:14 user nova-compute[75305]:     </migration_features>
Nov 14 07:58:14 user nova-compute[75305]:     <topology>
Nov 14 07:58:14 user nova-compute[75305]:       <cells num='2'>
Nov 14 07:58:14 user nova-compute[75305]:         <cell id='0'>
Nov 14 07:58:14 user nova-compute[75305]:           <memory unit='KiB'>8189224</memory>
Nov 14 07:58:14 user nova-compute[75305]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 14 07:58:14 user nova-compute[75305]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 07:58:14 user nova-compute[75305]:           <distances>
Nov 14 07:58:14 user nova-compute[75305]:             <sibling id='0' value='10'/>
Nov 14 07:58:14 user nova-compute[75305]:             <sibling id='1' value='20'/>
Nov 14 07:58:14 user nova-compute[75305]:           </distances>
Nov 14 07:58:14 user nova-compute[75305]:           <cpus num='6'>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 07:58:14 user nova-compute[75305]:           </cpus>
Nov 14 07:58:14 user nova-compute[75305]:         </cell>
Nov 14 07:58:14 user nova-compute[75305]:         <cell id='1'>
Nov 14 07:58:14 user nova-compute[75305]:           <memory unit='KiB'>8206460</memory>
Nov 14 07:58:14 user nova-compute[75305]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 14 07:58:14 user nova-compute[75305]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 07:58:14 user nova-compute[75305]:           <distances>
Nov 14 07:58:14 user nova-compute[75305]:             <sibling id='0' value='20'/>
Nov 14 07:58:14 user nova-compute[75305]:             <sibling id='1' value='10'/>
Nov 14 07:58:14 user nova-compute[75305]:           </distances>
Nov 14 07:58:14 user nova-compute[75305]:           <cpus num='6'>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 07:58:14 user nova-compute[75305]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 07:58:14 user nova-compute[75305]:           </cpus>
Nov 14 07:58:14 user nova-compute[75305]:         </cell>
Nov 14 07:58:14 user nova-compute[75305]:       </cells>
Nov 14 07:58:14 user nova-compute[75305]:     </topology>
Nov 14 07:58:14 user nova-compute[75305]:     <cache>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 07:58:14 user nova-compute[75305]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 07:58:14 user nova-compute[75305]:     </cache>
Nov 14 07:58:14 user nova-compute[75305]:     <secmodel>
Nov 14 07:58:14 user nova-compute[75305]:       <model>apparmor</model>
Nov 14 07:58:14 user nova-compute[75305]:       <doi>0</doi>
Nov 14 07:58:14 user nova-compute[75305]:     </secmodel>
Nov 14 07:58:14 user nova-compute[75305]:     <secmodel>
Nov 14 07:58:14 user nova-compute[75305]:       <model>dac</model>
Nov 14 07:58:14 user nova-compute[75305]:       <doi>0</doi>
Nov 14 07:58:14 user nova-compute[75305]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 07:58:14 user nova-compute[75305]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 07:58:14 user nova-compute[75305]:     </secmodel>
Nov 14 07:58:14 user nova-compute[75305]:   </host>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='alpha'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>clipper</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='armv6l'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>spitz</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>nuri</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>kzm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sx1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>z2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>tosa</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>n810</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>n800</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>terrier</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>midway</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>microbit</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>verdex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>highbank</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>akita</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>connex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>collie</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='armv7l'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>spitz</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>nuri</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>kzm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sx1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>z2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>tosa</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>n810</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>n800</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>terrier</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>midway</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>microbit</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>verdex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>highbank</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>akita</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>connex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>collie</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='aarch64'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>spitz</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>nuri</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>kzm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sx1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>z2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>tosa</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>n810</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>n800</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>terrier</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>midway</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>microbit</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>verdex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>highbank</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>akita</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>connex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>collie</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <acpi default='on' toggle='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='cris'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='i686'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>isapc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>microvm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='kvm'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <pae/>
Nov 14 07:58:14 user nova-compute[75305]:       <nonpae/>
Nov 14 07:58:14 user nova-compute[75305]:       <acpi default='on' toggle='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:       <apic default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='m68k'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>an5206</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>q800</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='microblaze'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='microblazeel'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='mips'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='16'>malta</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='mipsel'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='16'>malta</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='mips64'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='16'>malta</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>pica61</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>magnum</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='mips64el'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='16'>malta</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>pica61</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>magnum</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='16'>boston</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='ppc'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mac99</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>40p</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>taihu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='ppc64'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>taihu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>40p</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mac99</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='ppc64le'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>taihu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>40p</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>mac99</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='riscv32'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='8'>spike</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='8'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='riscv64'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='8'>spike</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='8'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='s390x'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='sh4'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>shix</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>r2d</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='sh4eb'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>shix</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>r2d</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='sparc'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>LX</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='sparc64'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>niagara</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='x86_64'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>64</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='1'>isapc</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>microvm</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='kvm'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <acpi default='on' toggle='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:       <apic default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='xtensa'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>sim</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>kc705</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>ml605</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx200</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx60</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]:   <guest>
Nov 14 07:58:14 user nova-compute[75305]:     <os_type>hvm</os_type>
Nov 14 07:58:14 user nova-compute[75305]:     <arch name='xtensaeb'>
Nov 14 07:58:14 user nova-compute[75305]:       <wordsize>32</wordsize>
Nov 14 07:58:14 user nova-compute[75305]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='4'>sim</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>kc705</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>ml605</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>virt</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx200</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>lx60</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 07:58:14 user nova-compute[75305]:       <domain type='qemu'/>
Nov 14 07:58:14 user nova-compute[75305]:     </arch>
Nov 14 07:58:14 user nova-compute[75305]:     <features>
Nov 14 07:58:14 user nova-compute[75305]:       <cpuselection/>
Nov 14 07:58:14 user nova-compute[75305]:       <deviceboot/>
Nov 14 07:58:14 user nova-compute[75305]:       <disksnapshot default='on' toggle='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     </features>
Nov 14 07:58:14 user nova-compute[75305]:   </guest>
Nov 14 07:58:14 user nova-compute[75305]: </capabilities>
Nov 14 07:58:14 user nova-compute[75305]: 
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-i440fx-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>i686</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='255'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'/>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='lm'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ide</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-i440fx-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>i686</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='255'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'/>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='lm'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ide</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-q35-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>i686</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='288'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'/>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='lm'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-q35-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>i686</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='288'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'/>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='lm'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-i440fx-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>x86_64</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='255'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>efi</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='invtsc'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='rsba'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ide</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-i440fx-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>x86_64</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='255'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>efi</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='invtsc'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='rsba'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ide</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-q35-6.2</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>x86_64</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='288'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>efi</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='invtsc'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='rsba'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 07:58:14 user nova-compute[75305]: <domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 07:58:14 user nova-compute[75305]:   <domain>kvm</domain>
Nov 14 07:58:14 user nova-compute[75305]:   <machine>pc-q35-jammy</machine>
Nov 14 07:58:14 user nova-compute[75305]:   <arch>x86_64</arch>
Nov 14 07:58:14 user nova-compute[75305]:   <vcpu max='288'/>
Nov 14 07:58:14 user nova-compute[75305]:   <iothreads supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:   <os supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='firmware'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>efi</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:     <loader supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>rom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pflash</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='readonly'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='secure'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>yes</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>no</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </loader>
Nov 14 07:58:14 user nova-compute[75305]:   </os>
Nov 14 07:58:14 user nova-compute[75305]:   <cpu>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-passthrough' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='hostPassthroughMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='maximum' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='maximumMigratable'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>on</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>off</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='host-model' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <vendor>Intel</vendor>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ss'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='vmx'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pcid'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='hypervisor'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arat'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='umip'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='md-clear'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='invtsc'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibpb'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='ibrs'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-stibp'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='rsba'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='erms'/>
Nov 14 07:58:14 user nova-compute[75305]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:     <mode name='custom' supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>qemu64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>qemu32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>phenom</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>pentium</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>n270</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm64</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>kvm32</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>coreduo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>core2duo</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>athlon</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Westmere</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Snowridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Skylake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>SandyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Penryn</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G5</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G4</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G3</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Opteron_G2</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Opteron_G1</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>IvyBridge</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Icelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Haswell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Rome</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-Milan</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>EPYC</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Dhyana</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cooperlake</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>Conroe</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='no'>Broadwell</model>
Nov 14 07:58:14 user nova-compute[75305]:       <model usable='yes'>486</model>
Nov 14 07:58:14 user nova-compute[75305]:     </mode>
Nov 14 07:58:14 user nova-compute[75305]:   </cpu>
Nov 14 07:58:14 user nova-compute[75305]:   <memoryBacking supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:     <enum name='sourceType'>
Nov 14 07:58:14 user nova-compute[75305]:       <value>file</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>anonymous</value>
Nov 14 07:58:14 user nova-compute[75305]:       <value>memfd</value>
Nov 14 07:58:14 user nova-compute[75305]:     </enum>
Nov 14 07:58:14 user nova-compute[75305]:   </memoryBacking>
Nov 14 07:58:14 user nova-compute[75305]:   <devices>
Nov 14 07:58:14 user nova-compute[75305]:     <disk supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='diskDevice'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>disk</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cdrom</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>floppy</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>lun</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='bus'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>fdc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sata</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </disk>
Nov 14 07:58:14 user nova-compute[75305]:     <graphics supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='type'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>sdl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vnc</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>spice</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egl-headless</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </graphics>
Nov 14 07:58:14 user nova-compute[75305]:     <video supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='modelType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>cirrus</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>vmvga</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>qxl</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>none</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>bochs</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>ramfb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </video>
Nov 14 07:58:14 user nova-compute[75305]:     <hostdev supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='mode'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>subsystem</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='startupPolicy'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>default</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>mandatory</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>requisite</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>optional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='subsysType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>usb</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>pci</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>scsi</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='capsType'/>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='pciBackend'/>
Nov 14 07:58:14 user nova-compute[75305]:     </hostdev>
Nov 14 07:58:14 user nova-compute[75305]:     <rng supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtio-non-transitional</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>random</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>egd</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>builtin</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </rng>
Nov 14 07:58:14 user nova-compute[75305]:     <filesystem supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='driverType'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>path</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>handle</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>virtiofs</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </filesystem>
Nov 14 07:58:14 user nova-compute[75305]:     <tpm supported='yes'>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='model'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-tis</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>tpm-crb</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:       <enum name='backendModel'>
Nov 14 07:58:14 user nova-compute[75305]:         <value>passthrough</value>
Nov 14 07:58:14 user nova-compute[75305]:         <value>emulator</value>
Nov 14 07:58:14 user nova-compute[75305]:       </enum>
Nov 14 07:58:14 user nova-compute[75305]:     </tpm>
Nov 14 07:58:14 user nova-compute[75305]:   </devices>
Nov 14 07:58:14 user nova-compute[75305]:   <features>
Nov 14 07:58:14 user nova-compute[75305]:     <gic supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:     <vmcoreinfo supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <genid supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backingStoreInput supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <backup supported='yes'/>
Nov 14 07:58:14 user nova-compute[75305]:     <sev supported='no'/>
Nov 14 07:58:14 user nova-compute[75305]:   </features>
Nov 14 07:58:14 user nova-compute[75305]: </domainCapabilities>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75305) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75305) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Checking secure boot support for host arch (x86_64) {{(pid=75305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Checking secure boot support for host arch (x86_64) {{(pid=75305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Checking secure boot support for host arch (x86_64) {{(pid=75305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Checking secure boot support for host arch (x86_64) {{(pid=75305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Checking secure boot support for host arch (x86_64) {{(pid=75305) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 07:58:14 user nova-compute[75305]: INFO nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Secure Boot support detected
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] cpu compare xml: <cpu match="exact">
Nov 14 07:58:14 user nova-compute[75305]:   <model>Nehalem</model>
Nov 14 07:58:14 user nova-compute[75305]: </cpu>
Nov 14 07:58:14 user nova-compute[75305]:  {{(pid=75305) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 07:58:14 user nova-compute[75305]: INFO nova.virt.node [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Generated node identity b140deac-8ace-4c60-902f-ce7a9011677b
Nov 14 07:58:14 user nova-compute[75305]: INFO nova.virt.node [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Wrote node identity b140deac-8ace-4c60-902f-ce7a9011677b to /opt/stack/data/nova/compute_id
Nov 14 07:58:14 user nova-compute[75305]: WARNING nova.compute.manager [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Compute nodes ['b140deac-8ace-4c60-902f-ce7a9011677b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 07:58:14 user nova-compute[75305]: INFO nova.compute.manager [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 07:58:14 user nova-compute[75305]: WARNING nova.compute.manager [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 07:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:58:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:58:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Hypervisor/Node resource view: name=user free_ram=10952MB free_disk=26.104835510253906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:58:14 user nova-compute[75305]: WARNING nova.compute.resource_tracker [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] No compute node record for user:b140deac-8ace-4c60-902f-ce7a9011677b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b140deac-8ace-4c60-902f-ce7a9011677b could not be found.
Nov 14 07:58:14 user nova-compute[75305]: INFO nova.compute.resource_tracker [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Compute node record created for user:user with uuid: b140deac-8ace-4c60-902f-ce7a9011677b
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:58:14 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:58:15 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] [req-aa86a57a-62a2-4362-8ccf-cb3cf65b95c8] Created resource provider record via placement API for resource provider with UUID b140deac-8ace-4c60-902f-ce7a9011677b and name user.
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75305) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 07:58:15 user nova-compute[75305]: INFO nova.virt.libvirt.host [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] kernel doesn't support AMD SEV
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Libvirt baseline CPU <cpu>
Nov 14 07:58:15 user nova-compute[75305]:   <arch>x86_64</arch>
Nov 14 07:58:15 user nova-compute[75305]:   <model>Nehalem</model>
Nov 14 07:58:15 user nova-compute[75305]:   <vendor>Intel</vendor>
Nov 14 07:58:15 user nova-compute[75305]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 07:58:15 user nova-compute[75305]: </cpu>
Nov 14 07:58:15 user nova-compute[75305]:  {{(pid=75305) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Updated inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Updating resource provider b140deac-8ace-4c60-902f-ce7a9011677b generation from 0 to 1 during operation: update_inventory {{(pid=75305) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Updating resource provider b140deac-8ace-4c60-902f-ce7a9011677b generation from 1 to 2 during operation: update_traits {{(pid=75305) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.service [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Creating RPC server for service compute {{(pid=75305) start /opt/stack/nova/nova/service.py:182}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.service [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] Join ServiceGroup membership for this service compute {{(pid=75305) start /opt/stack/nova/nova/service.py:199}}
Nov 14 07:58:15 user nova-compute[75305]: DEBUG nova.servicegroup.drivers.db [None req-bbc1a0fb-8ef7-4f07-a9a0-5db8ef0f5511 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75305) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 07:58:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:58:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 07:59:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:59:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=10361MB free_disk=26.008663177490234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 07:59:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:00:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:00:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:00:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=10320MB free_disk=26.069644927978516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:00:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:01:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:01:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:01:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:01:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=10340MB free_disk=25.825424194335938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:01:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:01:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:01:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:01:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:01:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:01:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:02:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9624MB free_disk=25.845447540283203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:02:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:02:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:02:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:02:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:02:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:16 user nova-compute[75305]: INFO nova.compute.claims [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Claim successful on node user
Nov 14 08:02:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.304s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:16 user nova-compute[75305]: INFO nova.compute.claims [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Claim successful on node user
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Creating image(s)
Nov 14 08:02:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "/opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "/opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "/opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.policy [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6126101718a429183c2553d9b552360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bf1ca93e8450293e5228c6ee1931f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.policy [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '574c9a82a4994bdcb60c5d96b199d69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a93139587f4dc0b2bd586961056c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.virt.images [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] 5d88aadf-7386-48ab-8524-9b99a75f107c was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.part /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:18 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Creating image(s)
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "/opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "/opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:18 user nova-compute[75305]: INFO nova.compute.claims [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Claim successful on node user
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.part /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.converted" returned: 0 in 0.328s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.514s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:18 user nova-compute[75305]: INFO oslo.privsep.daemon [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpic9l170y/privsep.sock']
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.496s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:18 user sudo[84568]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpic9l170y/privsep.sock
Nov 14 08:02:18 user sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:18 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.626s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:19 user nova-compute[75305]: INFO nova.compute.claims [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Claim successful on node user
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Creating image(s)
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.613s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:19 user nova-compute[75305]: INFO nova.compute.claims [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Claim successful on node user
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.policy [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6921b8792c4b4f098ee61c6d8bc840c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeba260be7f045959c391eb65633be89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Creating image(s)
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:20 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Creating image(s)
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG nova.policy [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18e38ea4aaf84e82afd404b88ae4d6cc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa8ff9cd1d54897a96c555021604b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG nova.policy [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7dda8620115b4ad5a5acc0c811ef44ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8b5236976e4be48b494cdbc69015b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:20 user sudo[84568]: pam_unix(sudo:session): session closed for user root
Nov 14 08:02:20 user nova-compute[75305]: INFO oslo.privsep.daemon [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Spawned new privsep daemon via rootwrap
Nov 14 08:02:20 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 08:02:20 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 08:02:20 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 08:02:20 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84572
Nov 14 08:02:20 user nova-compute[75305]: WARNING oslo_privsep.priv_context [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] privsep daemon already running
Nov 14 08:02:20 user nova-compute[75305]: WARNING oslo_privsep.priv_context [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] privsep daemon already running
Nov 14 08:02:20 user nova-compute[75305]: WARNING oslo_privsep.priv_context [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] privsep daemon already running
Nov 14 08:02:20 user nova-compute[75305]: WARNING oslo_privsep.priv_context [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] privsep daemon already running
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Successfully created port: 18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Successfully created port: a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.224s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.234s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.151s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.233s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk 1073741824" returned: 0 in 0.043s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.226s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.164s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk 1073741824" returned: 0 in 0.050s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.444s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Cannot resize image /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Ensure instance console log exists: /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.156s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.217s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk 1073741824" returned: 0 in 0.059s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.689s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Cannot resize image /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Ensure instance console log exists: /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.156s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk 1073741824" returned: 0 in 0.042s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.957s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Cannot resize image /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Ensure instance console log exists: /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.224s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.213s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk 1073741824" returned: 0 in 0.049s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Cannot resize image /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Ensure instance console log exists: /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.197s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Cannot resize image /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Ensure instance console log exists: /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Successfully created port: 9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Successfully updated port: a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquired lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Successfully created port: 488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-changed-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Refreshing instance network info cache due to event network-changed-a89876c5-db54-4173-ae04-a88c966b86b5. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] Acquiring lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Successfully created port: 11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Releasing lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Instance network_info: |[{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] Acquired lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Refreshing network info cache for port a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Start _get_guest_xml network_info=[{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:23 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:23 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1313446680',display_name='tempest-ServerActionsTestOtherA-server-1313446680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1313446680',id=1,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-zk2o7a6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=9736f35c-ddc9-4666-b5c4-cb1006c3fcf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:d4,bridge_name='br-int',has_traffic_filtering=True,id=a89876c5-db54-4173-ae04-a88c966b86b5,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89876c5-db') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'pci_devices' on Instance uuid 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:23 user nova-compute[75305]:   <uuid>9736f35c-ddc9-4666-b5c4-cb1006c3fcf9</uuid>
Nov 14 08:02:23 user nova-compute[75305]:   <name>instance-00000001</name>
Nov 14 08:02:23 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:23 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:23 user nova-compute[75305]:   <metadata>
Nov 14 08:02:23 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:23 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:23 user nova-compute[75305]:       <nova:name>tempest-ServerActionsTestOtherA-server-1313446680</nova:name>
Nov 14 08:02:23 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:23</nova:creationTime>
Nov 14 08:02:23 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:23 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:23 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:23 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:23 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:23 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:23 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:23 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:23 user nova-compute[75305]:         <nova:user uuid="574c9a82a4994bdcb60c5d96b199d69a">tempest-ServerActionsTestOtherA-723782501-project-member</nova:user>
Nov 14 08:02:23 user nova-compute[75305]:         <nova:project uuid="34a93139587f4dc0b2bd586961056c6c">tempest-ServerActionsTestOtherA-723782501</nova:project>
Nov 14 08:02:23 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:23 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:02:23 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:23 user nova-compute[75305]:         <nova:port uuid="a89876c5-db54-4173-ae04-a88c966b86b5">
Nov 14 08:02:23 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:02:23 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:23 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:23 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:23 user nova-compute[75305]:   </metadata>
Nov 14 08:02:23 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:23 user nova-compute[75305]:     <system>
Nov 14 08:02:23 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:23 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:23 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:23 user nova-compute[75305]:       <entry name="serial">9736f35c-ddc9-4666-b5c4-cb1006c3fcf9</entry>
Nov 14 08:02:23 user nova-compute[75305]:       <entry name="uuid">9736f35c-ddc9-4666-b5c4-cb1006c3fcf9</entry>
Nov 14 08:02:23 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:23 user nova-compute[75305]:     </system>
Nov 14 08:02:23 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:23 user nova-compute[75305]:   <os>
Nov 14 08:02:23 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:23 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:23 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:23 user nova-compute[75305]:   </os>
Nov 14 08:02:23 user nova-compute[75305]:   <features>
Nov 14 08:02:23 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:23 user nova-compute[75305]:     <apic/>
Nov 14 08:02:23 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:23 user nova-compute[75305]:   </features>
Nov 14 08:02:23 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:23 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:23 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:23 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:23 user nova-compute[75305]:   </clock>
Nov 14 08:02:23 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:23 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:23 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:23 user nova-compute[75305]:   </cpu>
Nov 14 08:02:23 user nova-compute[75305]:   <devices>
Nov 14 08:02:23 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:23 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:23 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk"/>
Nov 14 08:02:23 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:02:23 user nova-compute[75305]:     </disk>
Nov 14 08:02:23 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:23 user nova-compute[75305]:       <mac address="fa:16:3e:d5:66:d4"/>
Nov 14 08:02:23 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:23 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:23 user nova-compute[75305]:       <target dev="tapa89876c5-db"/>
Nov 14 08:02:23 user nova-compute[75305]:     </interface>
Nov 14 08:02:23 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:23 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/console.log" append="off"/>
Nov 14 08:02:23 user nova-compute[75305]:     </serial>
Nov 14 08:02:23 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:23 user nova-compute[75305]:     <video>
Nov 14 08:02:23 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:23 user nova-compute[75305]:     </video>
Nov 14 08:02:23 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:23 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:23 user nova-compute[75305]:     </rng>
Nov 14 08:02:23 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:23 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:23 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:23 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:23 user nova-compute[75305]:   </devices>
Nov 14 08:02:23 user nova-compute[75305]: </domain>
Nov 14 08:02:23 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1313446680',display_name='tempest-ServerActionsTestOtherA-server-1313446680',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1313446680',id=1,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-zk2o7a6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=9736f35c-ddc9-4666-b5c4-cb1006c3fcf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:d4,bridge_name='br-int',has_traffic_filtering=True,id=a89876c5-db54-4173-ae04-a88c966b86b5,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89876c5-db') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG os_vif [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:d4,bridge_name='br-int',has_traffic_filtering=True,id=a89876c5-db54-4173-ae04-a88c966b86b5,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89876c5-db') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Created schema index Interface.name {{(pid=75305) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Created schema index Port.name {{(pid=75305) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Created schema index Bridge.name {{(pid=75305) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [POLLOUT] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c7ef748-6060-575e-b077-3af07ea76004', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:23 user nova-compute[75305]: INFO oslo.privsep.daemon [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpeovclxx8/privsep.sock']
Nov 14 08:02:23 user sudo[84656]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpeovclxx8/privsep.sock
Nov 14 08:02:23 user sudo[84656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 08:02:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Successfully updated port: 18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquired lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Successfully updated port: 9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updated VIF entry in instance network info cache for port a89876c5-db54-4173-ae04-a88c966b86b5. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fc34634-17c3-4c9b-a400-b81129e2879f req-19f777c1-11cc-4140-84af-d98b55da008e service nova] Releasing lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Received event network-changed-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Refreshing instance network info cache due to event network-changed-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] Acquiring lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-changed-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Refreshing instance network info cache due to event network-changed-9f99886b-aaf5-4e84-a5d2-2e74015f4386. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:25 user sudo[84656]: pam_unix(sudo:session): session closed for user root
Nov 14 08:02:25 user nova-compute[75305]: INFO oslo.privsep.daemon [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Spawned new privsep daemon via rootwrap
Nov 14 08:02:25 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 08:02:25 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 08:02:25 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 08:02:25 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84661
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updating instance_info_cache with network_info: [{"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Releasing lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Instance network_info: |[{"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] Acquired lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Refreshing network info cache for port 18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Start _get_guest_xml network_info=[{"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2105155944',display_name='tempest-ServersNegativeTestJSON-server-2105155944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2105155944',id=2,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='527bf1ca93e8450293e5228c6ee1931f',ramdisk_id='',reservation_id='r-g8aru86p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281828421',owner_user_name='tempest-ServersNegativeTestJSON-281828421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:18Z,user_data=None,user_id='b6126101718a429183c2553d9b552360',uuid=f6ec11ae-2f25-4285-b810-ea4009d62c59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converting VIF {"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:e3,bridge_name='br-int',has_traffic_filtering=True,id=18fcd91e-06c0-40f6-99e4-fd3b7f2e4222,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fcd91e-06') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.objects.instance [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lazy-loading 'pci_devices' on Instance uuid f6ec11ae-2f25-4285-b810-ea4009d62c59 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:25 user nova-compute[75305]:   <uuid>f6ec11ae-2f25-4285-b810-ea4009d62c59</uuid>
Nov 14 08:02:25 user nova-compute[75305]:   <name>instance-00000002</name>
Nov 14 08:02:25 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:25 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:25 user nova-compute[75305]:   <metadata>
Nov 14 08:02:25 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:25 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:25 user nova-compute[75305]:       <nova:name>tempest-ServersNegativeTestJSON-server-2105155944</nova:name>
Nov 14 08:02:25 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:25</nova:creationTime>
Nov 14 08:02:25 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:25 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:25 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:25 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:25 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:25 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:25 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:25 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:25 user nova-compute[75305]:         <nova:user uuid="b6126101718a429183c2553d9b552360">tempest-ServersNegativeTestJSON-281828421-project-member</nova:user>
Nov 14 08:02:25 user nova-compute[75305]:         <nova:project uuid="527bf1ca93e8450293e5228c6ee1931f">tempest-ServersNegativeTestJSON-281828421</nova:project>
Nov 14 08:02:25 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:25 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:02:25 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:25 user nova-compute[75305]:         <nova:port uuid="18fcd91e-06c0-40f6-99e4-fd3b7f2e4222">
Nov 14 08:02:25 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:02:25 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:25 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:25 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:25 user nova-compute[75305]:   </metadata>
Nov 14 08:02:25 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:25 user nova-compute[75305]:     <system>
Nov 14 08:02:25 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:25 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:25 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:25 user nova-compute[75305]:       <entry name="serial">f6ec11ae-2f25-4285-b810-ea4009d62c59</entry>
Nov 14 08:02:25 user nova-compute[75305]:       <entry name="uuid">f6ec11ae-2f25-4285-b810-ea4009d62c59</entry>
Nov 14 08:02:25 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:25 user nova-compute[75305]:     </system>
Nov 14 08:02:25 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:25 user nova-compute[75305]:   <os>
Nov 14 08:02:25 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:25 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:25 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:25 user nova-compute[75305]:   </os>
Nov 14 08:02:25 user nova-compute[75305]:   <features>
Nov 14 08:02:25 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:25 user nova-compute[75305]:     <apic/>
Nov 14 08:02:25 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:25 user nova-compute[75305]:   </features>
Nov 14 08:02:25 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:25 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:25 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:25 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:25 user nova-compute[75305]:   </clock>
Nov 14 08:02:25 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:25 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:25 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:25 user nova-compute[75305]:   </cpu>
Nov 14 08:02:25 user nova-compute[75305]:   <devices>
Nov 14 08:02:25 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:25 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:25 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk"/>
Nov 14 08:02:25 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:02:25 user nova-compute[75305]:     </disk>
Nov 14 08:02:25 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:25 user nova-compute[75305]:       <mac address="fa:16:3e:2f:f7:e3"/>
Nov 14 08:02:25 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:25 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:25 user nova-compute[75305]:       <target dev="tap18fcd91e-06"/>
Nov 14 08:02:25 user nova-compute[75305]:     </interface>
Nov 14 08:02:25 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:25 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/console.log" append="off"/>
Nov 14 08:02:25 user nova-compute[75305]:     </serial>
Nov 14 08:02:25 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:25 user nova-compute[75305]:     <video>
Nov 14 08:02:25 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:25 user nova-compute[75305]:     </video>
Nov 14 08:02:25 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:25 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:25 user nova-compute[75305]:     </rng>
Nov 14 08:02:25 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:25 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:25 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:25 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:25 user nova-compute[75305]:   </devices>
Nov 14 08:02:25 user nova-compute[75305]: </domain>
Nov 14 08:02:25 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2105155944',display_name='tempest-ServersNegativeTestJSON-server-2105155944',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2105155944',id=2,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='527bf1ca93e8450293e5228c6ee1931f',ramdisk_id='',reservation_id='r-g8aru86p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281828421',owner_user_name='tempest-ServersNegativeTestJSON-281828421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:18Z,user_data=None,user_id='b6126101718a429183c2553d9b552360',uuid=f6ec11ae-2f25-4285-b810-ea4009d62c59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converting VIF {"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:e3,bridge_name='br-int',has_traffic_filtering=True,id=18fcd91e-06c0-40f6-99e4-fd3b7f2e4222,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fcd91e-06') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG os_vif [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:e3,bridge_name='br-int',has_traffic_filtering=True,id=18fcd91e-06c0-40f6-99e4-fd3b7f2e4222,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fcd91e-06') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a35212d5-eadf-58ce-898a-877336564dc2', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18fcd91e-06, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18fcd91e-06, col_values=(('qos', UUID('eef92460-c743-439a-8a50-8fa7e7473ac1')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18fcd91e-06, col_values=(('external_ids', {'iface-id': '18fcd91e-06c0-40f6-99e4-fd3b7f2e4222', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:f7:e3', 'vm-uuid': 'f6ec11ae-2f25-4285-b810-ea4009d62c59'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Successfully updated port: 488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: INFO os_vif [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:f7:e3,bridge_name='br-int',has_traffic_filtering=True,id=18fcd91e-06c0-40f6-99e4-fd3b7f2e4222,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fcd91e-06')
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa89876c5-db, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa89876c5-db, col_values=(('qos', UUID('0c325ae1-65bf-4765-9960-53a40771cafe')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa89876c5-db, col_values=(('external_ids', {'iface-id': 'a89876c5-db54-4173-ae04-a88c966b86b5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:66:d4', 'vm-uuid': '9736f35c-ddc9-4666-b5c4-cb1006c3fcf9'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquired lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:25 user nova-compute[75305]: INFO os_vif [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:66:d4,bridge_name='br-int',has_traffic_filtering=True,id=a89876c5-db54-4173-ae04-a88c966b86b5,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89876c5-db')
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] No VIF found with MAC fa:16:3e:2f:f7:e3, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No VIF found with MAC fa:16:3e:d5:66:d4, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Successfully updated port: 11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance network_info: |[{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.neutron [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Refreshing network info cache for port 9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Start _get_guest_xml network_info=[{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:26 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:26 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lazy-loading 'pci_devices' on Instance uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:26 user nova-compute[75305]:   <uuid>ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</uuid>
Nov 14 08:02:26 user nova-compute[75305]:   <name>instance-00000005</name>
Nov 14 08:02:26 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:26 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:26 user nova-compute[75305]:   <metadata>
Nov 14 08:02:26 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:26 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:26 user nova-compute[75305]:       <nova:name>tempest-ServerActionsTestOtherB-server-559180561</nova:name>
Nov 14 08:02:26 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:26</nova:creationTime>
Nov 14 08:02:26 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:26 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:26 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:26 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:26 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:26 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:26 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:26 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:26 user nova-compute[75305]:         <nova:user uuid="7dda8620115b4ad5a5acc0c811ef44ee">tempest-ServerActionsTestOtherB-1488485775-project-member</nova:user>
Nov 14 08:02:26 user nova-compute[75305]:         <nova:project uuid="cd8b5236976e4be48b494cdbc69015b4">tempest-ServerActionsTestOtherB-1488485775</nova:project>
Nov 14 08:02:26 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:26 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:02:26 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:26 user nova-compute[75305]:         <nova:port uuid="9f99886b-aaf5-4e84-a5d2-2e74015f4386">
Nov 14 08:02:26 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 08:02:26 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:26 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:26 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:26 user nova-compute[75305]:   </metadata>
Nov 14 08:02:26 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:26 user nova-compute[75305]:     <system>
Nov 14 08:02:26 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:26 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:26 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:26 user nova-compute[75305]:       <entry name="serial">ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</entry>
Nov 14 08:02:26 user nova-compute[75305]:       <entry name="uuid">ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</entry>
Nov 14 08:02:26 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:26 user nova-compute[75305]:     </system>
Nov 14 08:02:26 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:26 user nova-compute[75305]:   <os>
Nov 14 08:02:26 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:26 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:26 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:26 user nova-compute[75305]:   </os>
Nov 14 08:02:26 user nova-compute[75305]:   <features>
Nov 14 08:02:26 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:26 user nova-compute[75305]:     <apic/>
Nov 14 08:02:26 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:26 user nova-compute[75305]:   </features>
Nov 14 08:02:26 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:26 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:26 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:26 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:26 user nova-compute[75305]:   </clock>
Nov 14 08:02:26 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:26 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:26 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:26 user nova-compute[75305]:   </cpu>
Nov 14 08:02:26 user nova-compute[75305]:   <devices>
Nov 14 08:02:26 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:26 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:26 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk"/>
Nov 14 08:02:26 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:02:26 user nova-compute[75305]:     </disk>
Nov 14 08:02:26 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:26 user nova-compute[75305]:       <mac address="fa:16:3e:ed:e6:07"/>
Nov 14 08:02:26 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:26 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:26 user nova-compute[75305]:       <target dev="tap9f99886b-aa"/>
Nov 14 08:02:26 user nova-compute[75305]:     </interface>
Nov 14 08:02:26 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:26 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/console.log" append="off"/>
Nov 14 08:02:26 user nova-compute[75305]:     </serial>
Nov 14 08:02:26 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:26 user nova-compute[75305]:     <video>
Nov 14 08:02:26 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:26 user nova-compute[75305]:     </video>
Nov 14 08:02:26 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:26 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:26 user nova-compute[75305]:     </rng>
Nov 14 08:02:26 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:26 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:26 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:26 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:26 user nova-compute[75305]:   </devices>
Nov 14 08:02:26 user nova-compute[75305]: </domain>
Nov 14 08:02:26 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG os_vif [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '939d6e4f-8c81-5e97-aec7-8ed78d24a5cf', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f99886b-aa, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f99886b-aa, col_values=(('qos', UUID('88f4841b-2862-4f6d-896b-3a240fac90c8')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f99886b-aa, col_values=(('external_ids', {'iface-id': '9f99886b-aaf5-4e84-a5d2-2e74015f4386', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:e6:07', 'vm-uuid': 'ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: INFO os_vif [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa')
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No VIF found with MAC fa:16:3e:ed:e6:07, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-changed-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Refreshing instance network info cache due to event network-changed-488cb4fa-c020-4834-a6e0-62c7f76dd23d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] Acquiring lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updating instance_info_cache with network_info: [{"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Releasing lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Instance network_info: |[{"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] Acquired lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Refreshing network info cache for port 488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Start _get_guest_xml network_info=[{"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:27 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:27 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-89483256',display_name='tempest-AttachVolumeNegativeTest-server-89483256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-89483256',id=4,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCySHxoMFLrXs08uhdcGYy02FJJfNatLmr/7HW18vIP10bYQ5HjK4yTPrw9f/QBmtcMyIfFc3hk75XXBd/AOBEq3jvevcV7zcnnGjweI6bUsFRjsdndjGgVnUhWkDb3H+w==',key_name='tempest-keypair-1025161906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-khbh2iv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=6dd11b5a-6147-4cd1-965a-19f75a091198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=488cb4fa-c020-4834-a6e0-62c7f76dd23d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488cb4fa-c0') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dd11b5a-6147-4cd1-965a-19f75a091198 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:27 user nova-compute[75305]:   <uuid>6dd11b5a-6147-4cd1-965a-19f75a091198</uuid>
Nov 14 08:02:27 user nova-compute[75305]:   <name>instance-00000004</name>
Nov 14 08:02:27 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:27 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:27 user nova-compute[75305]:   <metadata>
Nov 14 08:02:27 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:27 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-89483256</nova:name>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:27</nova:creationTime>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:27 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:27 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:user uuid="6921b8792c4b4f098ee61c6d8bc840c9">tempest-AttachVolumeNegativeTest-1514251643-project-member</nova:user>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:project uuid="aeba260be7f045959c391eb65633be89">tempest-AttachVolumeNegativeTest-1514251643</nova:project>
Nov 14 08:02:27 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:port uuid="488cb4fa-c020-4834-a6e0-62c7f76dd23d">
Nov 14 08:02:27 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 08:02:27 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:27 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:27 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:27 user nova-compute[75305]:   </metadata>
Nov 14 08:02:27 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:27 user nova-compute[75305]:     <system>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="serial">6dd11b5a-6147-4cd1-965a-19f75a091198</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="uuid">6dd11b5a-6147-4cd1-965a-19f75a091198</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:27 user nova-compute[75305]:     </system>
Nov 14 08:02:27 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:27 user nova-compute[75305]:   <os>
Nov 14 08:02:27 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:27 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:27 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:27 user nova-compute[75305]:   </os>
Nov 14 08:02:27 user nova-compute[75305]:   <features>
Nov 14 08:02:27 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:27 user nova-compute[75305]:     <apic/>
Nov 14 08:02:27 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:27 user nova-compute[75305]:   </features>
Nov 14 08:02:27 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:27 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:27 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:27 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:27 user nova-compute[75305]:   </clock>
Nov 14 08:02:27 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:27 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:27 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:27 user nova-compute[75305]:   </cpu>
Nov 14 08:02:27 user nova-compute[75305]:   <devices>
Nov 14 08:02:27 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:27 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:27 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk"/>
Nov 14 08:02:27 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:02:27 user nova-compute[75305]:     </disk>
Nov 14 08:02:27 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:27 user nova-compute[75305]:       <mac address="fa:16:3e:86:a0:f3"/>
Nov 14 08:02:27 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:27 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:27 user nova-compute[75305]:       <target dev="tap488cb4fa-c0"/>
Nov 14 08:02:27 user nova-compute[75305]:     </interface>
Nov 14 08:02:27 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:27 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/console.log" append="off"/>
Nov 14 08:02:27 user nova-compute[75305]:     </serial>
Nov 14 08:02:27 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:27 user nova-compute[75305]:     <video>
Nov 14 08:02:27 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:27 user nova-compute[75305]:     </video>
Nov 14 08:02:27 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:27 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:27 user nova-compute[75305]:     </rng>
Nov 14 08:02:27 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:27 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:27 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:27 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:27 user nova-compute[75305]:   </devices>
Nov 14 08:02:27 user nova-compute[75305]: </domain>
Nov 14 08:02:27 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-89483256',display_name='tempest-AttachVolumeNegativeTest-server-89483256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-89483256',id=4,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCySHxoMFLrXs08uhdcGYy02FJJfNatLmr/7HW18vIP10bYQ5HjK4yTPrw9f/QBmtcMyIfFc3hk75XXBd/AOBEq3jvevcV7zcnnGjweI6bUsFRjsdndjGgVnUhWkDb3H+w==',key_name='tempest-keypair-1025161906',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-khbh2iv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=6dd11b5a-6147-4cd1-965a-19f75a091198,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=488cb4fa-c020-4834-a6e0-62c7f76dd23d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488cb4fa-c0') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG os_vif [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=488cb4fa-c020-4834-a6e0-62c7f76dd23d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488cb4fa-c0') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f46e4e3f-0a2c-5407-978f-8c7c534899c7', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap488cb4fa-c0, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap488cb4fa-c0, col_values=(('qos', UUID('72c01b72-fc68-4149-a5bd-d3429f057585')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap488cb4fa-c0, col_values=(('external_ids', {'iface-id': '488cb4fa-c020-4834-a6e0-62c7f76dd23d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:a0:f3', 'vm-uuid': '6dd11b5a-6147-4cd1-965a-19f75a091198'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updated VIF entry in instance network info cache for port 18fcd91e-06c0-40f6-99e4-fd3b7f2e4222. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updating instance_info_cache with network_info: [{"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: INFO os_vif [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=488cb4fa-c020-4834-a6e0-62c7f76dd23d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488cb4fa-c0')
Nov 14 08:02:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e036b6f0-3a37-4d30-954e-6f5dfc56b045 req-91adcdda-0c8c-426a-a806-e40e2ea7a81f service nova] Releasing lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No VIF found with MAC fa:16:3e:86:a0:f3, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.neutron [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance network_info: |[{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Start _get_guest_xml network_info=[{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:27 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:27 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-943852596',display_name='tempest-ServerStableDeviceRescueTest-server-943852596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-943852596',id=3,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5yoSnB7TPx2ScUHUeCSeilBC6NPHdqO/tlTcNF4+qm6O99Zzd7+sVaj7DbuusQ21GcjrgPt0ZWBVmhYkzdVe4Qy9hFQIiVYujxr2o4UKvSp4MMiIV/5ORL5AoTD5Zjng==',key_name='tempest-keypair-1894394159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa8ff9cd1d54897a96c555021604b00',ramdisk_id='',reservation_id='r-0f8a7vk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1375221339',owner_user_name='tempest-ServerStableDeviceRescueTest-1375221339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18e38ea4aaf84e82afd404b88ae4d6cc',uuid=f5959dc8-a417-4528-9f03-3951186c2315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converting VIF {"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.objects.instance [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'pci_devices' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:27 user nova-compute[75305]:   <uuid>f5959dc8-a417-4528-9f03-3951186c2315</uuid>
Nov 14 08:02:27 user nova-compute[75305]:   <name>instance-00000003</name>
Nov 14 08:02:27 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:27 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:27 user nova-compute[75305]:   <metadata>
Nov 14 08:02:27 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:27 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-943852596</nova:name>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:27</nova:creationTime>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:27 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:27 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:user uuid="18e38ea4aaf84e82afd404b88ae4d6cc">tempest-ServerStableDeviceRescueTest-1375221339-project-member</nova:user>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:project uuid="1fa8ff9cd1d54897a96c555021604b00">tempest-ServerStableDeviceRescueTest-1375221339</nova:project>
Nov 14 08:02:27 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:02:27 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:27 user nova-compute[75305]:         <nova:port uuid="11d90697-5697-4fd9-8284-99e99196df6e">
Nov 14 08:02:27 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:02:27 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:27 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:27 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:27 user nova-compute[75305]:   </metadata>
Nov 14 08:02:27 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:27 user nova-compute[75305]:     <system>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="serial">f5959dc8-a417-4528-9f03-3951186c2315</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="uuid">f5959dc8-a417-4528-9f03-3951186c2315</entry>
Nov 14 08:02:27 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:27 user nova-compute[75305]:     </system>
Nov 14 08:02:27 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:27 user nova-compute[75305]:   <os>
Nov 14 08:02:27 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:27 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:27 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:27 user nova-compute[75305]:   </os>
Nov 14 08:02:27 user nova-compute[75305]:   <features>
Nov 14 08:02:27 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:27 user nova-compute[75305]:     <apic/>
Nov 14 08:02:27 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:27 user nova-compute[75305]:   </features>
Nov 14 08:02:27 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:27 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:27 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:27 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:27 user nova-compute[75305]:   </clock>
Nov 14 08:02:27 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:27 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:27 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:27 user nova-compute[75305]:   </cpu>
Nov 14 08:02:27 user nova-compute[75305]:   <devices>
Nov 14 08:02:27 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:27 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:27 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk"/>
Nov 14 08:02:27 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:02:27 user nova-compute[75305]:     </disk>
Nov 14 08:02:27 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:27 user nova-compute[75305]:       <mac address="fa:16:3e:97:d5:dc"/>
Nov 14 08:02:27 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:27 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:27 user nova-compute[75305]:       <target dev="tap11d90697-56"/>
Nov 14 08:02:27 user nova-compute[75305]:     </interface>
Nov 14 08:02:27 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:27 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/console.log" append="off"/>
Nov 14 08:02:27 user nova-compute[75305]:     </serial>
Nov 14 08:02:27 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:27 user nova-compute[75305]:     <video>
Nov 14 08:02:27 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:27 user nova-compute[75305]:     </video>
Nov 14 08:02:27 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:27 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:27 user nova-compute[75305]:     </rng>
Nov 14 08:02:27 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:27 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:27 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:27 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:27 user nova-compute[75305]:   </devices>
Nov 14 08:02:27 user nova-compute[75305]: </domain>
Nov 14 08:02:27 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-943852596',display_name='tempest-ServerStableDeviceRescueTest-server-943852596',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-943852596',id=3,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5yoSnB7TPx2ScUHUeCSeilBC6NPHdqO/tlTcNF4+qm6O99Zzd7+sVaj7DbuusQ21GcjrgPt0ZWBVmhYkzdVe4Qy9hFQIiVYujxr2o4UKvSp4MMiIV/5ORL5AoTD5Zjng==',key_name='tempest-keypair-1894394159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fa8ff9cd1d54897a96c555021604b00',ramdisk_id='',reservation_id='r-0f8a7vk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1375221339',owner_user_name='tempest-ServerStableDeviceRescueTest-1375221339-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18e38ea4aaf84e82afd404b88ae4d6cc',uuid=f5959dc8-a417-4528-9f03-3951186c2315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converting VIF {"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG os_vif [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '522b4302-0b26-5b59-af98-ca155512c73f', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11d90697-56, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11d90697-56, col_values=(('qos', UUID('a22f58f3-055e-4064-a1a0-e7492a19ce59')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11d90697-56, col_values=(('external_ids', {'iface-id': '11d90697-5697-4fd9-8284-99e99196df6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:d5:dc', 'vm-uuid': 'f5959dc8-a417-4528-9f03-3951186c2315'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:27 user nova-compute[75305]: INFO os_vif [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56')
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No VIF found with MAC fa:16:3e:97:d5:dc, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updated VIF entry in instance network info cache for port 488cb4fa-c020-4834-a6e0-62c7f76dd23d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updating instance_info_cache with network_info: [{"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] Releasing lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-changed-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing instance network info cache due to event network-changed-11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updated VIF entry in instance network info cache for port 9f99886b-aaf5-4e84-a5d2-2e74015f4386. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d83e46f-4362-46f0-bfa5-72bb365ef382 req-471b5dc4-96d8-4c5c-b324-6f7f07808749 service nova] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updated VIF entry in instance network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfd9d668-624d-483a-8b3c-1225ca0c5ac3 req-9f7d7ec4-9ce6-4407-b452-d9bf7b775610 service nova] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-336d93d8-6f8a-4f61-aca8-848ec1524f7f req-1e7c3dd6-d5ea-4a94-b6b5-677bf88b9d51 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-336d93d8-6f8a-4f61-aca8-848ec1524f7f req-1e7c3dd6-d5ea-4a94-b6b5-677bf88b9d51 service nova] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-336d93d8-6f8a-4f61-aca8-848ec1524f7f req-1e7c3dd6-d5ea-4a94-b6b5-677bf88b9d51 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-336d93d8-6f8a-4f61-aca8-848ec1524f7f req-1e7c3dd6-d5ea-4a94-b6b5-677bf88b9d51 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-336d93d8-6f8a-4f61-aca8-848ec1524f7f req-1e7c3dd6-d5ea-4a94-b6b5-677bf88b9d51 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] No waiting events found dispatching network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:34 user nova-compute[75305]: WARNING nova.compute.manager [req-336d93d8-6f8a-4f61-aca8-848ec1524f7f req-1e7c3dd6-d5ea-4a94-b6b5-677bf88b9d51 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received unexpected event network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 for instance with vm_state building and task_state spawning.
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:02:34 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Instance spawned successfully.
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:35 user nova-compute[75305]: INFO nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Took 16.78 seconds to spawn the instance on the hypervisor.
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:02:35 user nova-compute[75305]: INFO nova.compute.manager [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Took 18.85 seconds to build instance.
Nov 14 08:02:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-24760240-0da0-41a9-b977-c7aa3e136afe tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.348s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:02:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance spawned successfully.
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Instance spawned successfully.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance spawned successfully.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Instance spawned successfully.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Took 16.45 seconds to spawn the instance on the hypervisor.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Took 17.00 seconds to spawn the instance on the hypervisor.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Took 16.35 seconds to spawn the instance on the hypervisor.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Took 19.12 seconds to spawn the instance on the hypervisor.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Took 18.07 seconds to build instance.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-56db9685-13dc-4e7a-8c50-4ce212574d03 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.319s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Took 18.24 seconds to build instance.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-2b0942b0-fc3b-41dd-bce7-327ad5705f96 req-dc3972f3-a4f4-4c55-83d5-736d94e23756 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2b0942b0-fc3b-41dd-bce7-327ad5705f96 req-dc3972f3-a4f4-4c55-83d5-736d94e23756 service nova] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2b0942b0-fc3b-41dd-bce7-327ad5705f96 req-dc3972f3-a4f4-4c55-83d5-736d94e23756 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2b0942b0-fc3b-41dd-bce7-327ad5705f96 req-dc3972f3-a4f4-4c55-83d5-736d94e23756 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-2b0942b0-fc3b-41dd-bce7-327ad5705f96 req-dc3972f3-a4f4-4c55-83d5-736d94e23756 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] No waiting events found dispatching network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:36 user nova-compute[75305]: WARNING nova.compute.manager [req-2b0942b0-fc3b-41dd-bce7-327ad5705f96 req-dc3972f3-a4f4-4c55-83d5-736d94e23756 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received unexpected event network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 for instance with vm_state building and task_state spawning.
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Took 17.95 seconds to build instance.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a654b261-b2f9-4b6a-9a28-f1db7bf6c22e tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.434s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3ac94c11-67c1-4861-ac93-9e69c9fa7f03 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.288s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:36 user nova-compute[75305]: INFO nova.compute.manager [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Took 20.46 seconds to build instance.
Nov 14 08:02:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d25c0866-4774-47b5-bf55-374d1ab34141 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.864s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:37 user nova-compute[75305]: INFO nova.compute.claims [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Claim successful on node user
Nov 14 08:02:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:37 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Creating image(s)
Nov 14 08:02:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "/opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "/opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "04ad65805c7fa3332142c7ffa42d57bd23622934" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "04ad65805c7fa3332142c7ffa42d57bd23622934" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:38 user nova-compute[75305]: DEBUG nova.policy [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '27651c0687384b53acf859ca6c7196c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50d4081bd0d1409898c14ff5e16f23d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.part --force-share --output=json" returned: 0 in 0.434s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG nova.virt.images [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] 39db806b-56f9-431d-a8ff-d7cae9a2e2a0 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.part /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:39 user nova-compute[75305]: INFO nova.compute.claims [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Claim successful on node user
Nov 14 08:02:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.part /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.converted" returned: 0 in 0.505s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934.converted --force-share --output=json" returned: 0 in 0.260s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "04ad65805c7fa3332142c7ffa42d57bd23622934" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.907s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934 --force-share --output=json" returned: 0 in 0.303s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "04ad65805c7fa3332142c7ffa42d57bd23622934" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "04ad65805c7fa3332142c7ffa42d57bd23622934" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Successfully created port: f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934 --force-share --output=json" returned: 0 in 0.214s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934,backing_fmt=raw /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.152s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934,backing_fmt=raw /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk 1073741824" returned: 0 in 0.114s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "04ad65805c7fa3332142c7ffa42d57bd23622934" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.policy [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c90e99f86334376bdbfd4b76263fd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed60def7f2d441fcb3147dc96fdce086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934 --force-share --output=json" returned: 0 in 0.372s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Creating image(s)
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Cannot resize image /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Ensure instance console log exists: /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.303s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Successfully updated port: f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquired lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-changed-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Refreshing instance network info cache due to event network-changed-f47f5f90-3725-47e3-a576-90bce6f62f7f. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] Acquiring lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.491s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk 1073741824" returned: 0 in 0.093s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.594s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.308s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Updating instance_info_cache with network_info: [{"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Releasing lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Instance network_info: |[{"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] Acquired lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Refreshing network info cache for port f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Start _get_guest_xml network_info=[{"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T08:02:30Z,direct_url=<?>,disk_format='qcow2',id=39db806b-56f9-431d-a8ff-d7cae9a2e2a0,min_disk=0,min_ram=0,name='',owner='f4a9de87d60949179be50ac951b21849',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T08:02:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'image_id': '39db806b-56f9-431d-a8ff-d7cae9a2e2a0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Cannot resize image /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Ensure instance console log exists: /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:43 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:43 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T08:02:30Z,direct_url=<?>,disk_format='qcow2',id=39db806b-56f9-431d-a8ff-d7cae9a2e2a0,min_disk=0,min_ram=0,name='',owner='f4a9de87d60949179be50ac951b21849',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T08:02:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-360004631',display_name='tempest-AttachSCSIVolumeTestJSON-server-360004631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-360004631',id=6,image_ref='39db806b-56f9-431d-a8ff-d7cae9a2e2a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeX958K7+3/TzrVw8k1UvKZHW9vxczAjXWLs0tUYa/O/sJ7fNmK1bnGtwPoeQr87rOT5F9QrCL5SFHD6QN+qBqiNluy0urjdjSRXWBwL+PGPHYDz8wRvhswmJHkpD4qEA==',key_name='tempest-keypair-1386826451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50d4081bd0d1409898c14ff5e16f23d6',ramdisk_id='',reservation_id='r-iy4v0vln',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='39db806b-56f9-431d-a8ff-d7cae9a2e2a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1362657914',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1362657914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27651c0687384b53acf859ca6c7196c3',uuid=9cc7b521-becf-40dc-bbef-fd6523e59b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Converting VIF {"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:39,bridge_name='br-int',has_traffic_filtering=True,id=f47f5f90-3725-47e3-a576-90bce6f62f7f,network=Network(62c40656-2bcc-4d32-b16e-b464500f89ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47f5f90-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.objects.instance [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cc7b521-becf-40dc-bbef-fd6523e59b50 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Successfully created port: 88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:43 user nova-compute[75305]:   <uuid>9cc7b521-becf-40dc-bbef-fd6523e59b50</uuid>
Nov 14 08:02:43 user nova-compute[75305]:   <name>instance-00000006</name>
Nov 14 08:02:43 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:43 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:43 user nova-compute[75305]:   <metadata>
Nov 14 08:02:43 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:43 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:43 user nova-compute[75305]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-360004631</nova:name>
Nov 14 08:02:43 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:43</nova:creationTime>
Nov 14 08:02:43 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:43 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:43 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:43 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:43 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:43 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:43 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:43 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:43 user nova-compute[75305]:         <nova:user uuid="27651c0687384b53acf859ca6c7196c3">tempest-AttachSCSIVolumeTestJSON-1362657914-project-member</nova:user>
Nov 14 08:02:43 user nova-compute[75305]:         <nova:project uuid="50d4081bd0d1409898c14ff5e16f23d6">tempest-AttachSCSIVolumeTestJSON-1362657914</nova:project>
Nov 14 08:02:43 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:43 user nova-compute[75305]:       <nova:root type="image" uuid="39db806b-56f9-431d-a8ff-d7cae9a2e2a0"/>
Nov 14 08:02:43 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:43 user nova-compute[75305]:         <nova:port uuid="f47f5f90-3725-47e3-a576-90bce6f62f7f">
Nov 14 08:02:43 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 08:02:43 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:43 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:43 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:43 user nova-compute[75305]:   </metadata>
Nov 14 08:02:43 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:43 user nova-compute[75305]:     <system>
Nov 14 08:02:43 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:43 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:43 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:43 user nova-compute[75305]:       <entry name="serial">9cc7b521-becf-40dc-bbef-fd6523e59b50</entry>
Nov 14 08:02:43 user nova-compute[75305]:       <entry name="uuid">9cc7b521-becf-40dc-bbef-fd6523e59b50</entry>
Nov 14 08:02:43 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:43 user nova-compute[75305]:     </system>
Nov 14 08:02:43 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:43 user nova-compute[75305]:   <os>
Nov 14 08:02:43 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:43 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:43 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:43 user nova-compute[75305]:   </os>
Nov 14 08:02:43 user nova-compute[75305]:   <features>
Nov 14 08:02:43 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:43 user nova-compute[75305]:     <apic/>
Nov 14 08:02:43 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:43 user nova-compute[75305]:   </features>
Nov 14 08:02:43 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:43 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:43 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:43 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:43 user nova-compute[75305]:   </clock>
Nov 14 08:02:43 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:43 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:43 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:43 user nova-compute[75305]:   </cpu>
Nov 14 08:02:43 user nova-compute[75305]:   <devices>
Nov 14 08:02:43 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:43 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:43 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk"/>
Nov 14 08:02:43 user nova-compute[75305]:       <target dev="sda" bus="scsi"/>
Nov 14 08:02:43 user nova-compute[75305]:       <address type="drive" controller="0" unit="0"/>
Nov 14 08:02:43 user nova-compute[75305]:     </disk>
Nov 14 08:02:43 user nova-compute[75305]:     <disk type="file" device="cdrom">
Nov 14 08:02:43 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 08:02:43 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk.config"/>
Nov 14 08:02:43 user nova-compute[75305]:       <target dev="sdb" bus="scsi"/>
Nov 14 08:02:43 user nova-compute[75305]:       <address type="drive" controller="0" unit="1"/>
Nov 14 08:02:43 user nova-compute[75305]:     </disk>
Nov 14 08:02:43 user nova-compute[75305]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 08:02:43 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:43 user nova-compute[75305]:       <mac address="fa:16:3e:78:c1:39"/>
Nov 14 08:02:43 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:43 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:43 user nova-compute[75305]:       <target dev="tapf47f5f90-37"/>
Nov 14 08:02:43 user nova-compute[75305]:     </interface>
Nov 14 08:02:43 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:43 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/console.log" append="off"/>
Nov 14 08:02:43 user nova-compute[75305]:     </serial>
Nov 14 08:02:43 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:43 user nova-compute[75305]:     <video>
Nov 14 08:02:43 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:43 user nova-compute[75305]:     </video>
Nov 14 08:02:43 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:43 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:43 user nova-compute[75305]:     </rng>
Nov 14 08:02:43 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:43 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:43 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:43 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:43 user nova-compute[75305]:   </devices>
Nov 14 08:02:43 user nova-compute[75305]: </domain>
Nov 14 08:02:43 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-360004631',display_name='tempest-AttachSCSIVolumeTestJSON-server-360004631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-360004631',id=6,image_ref='39db806b-56f9-431d-a8ff-d7cae9a2e2a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeX958K7+3/TzrVw8k1UvKZHW9vxczAjXWLs0tUYa/O/sJ7fNmK1bnGtwPoeQr87rOT5F9QrCL5SFHD6QN+qBqiNluy0urjdjSRXWBwL+PGPHYDz8wRvhswmJHkpD4qEA==',key_name='tempest-keypair-1386826451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='50d4081bd0d1409898c14ff5e16f23d6',ramdisk_id='',reservation_id='r-iy4v0vln',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='39db806b-56f9-431d-a8ff-d7cae9a2e2a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1362657914',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1362657914-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27651c0687384b53acf859ca6c7196c3',uuid=9cc7b521-becf-40dc-bbef-fd6523e59b50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Converting VIF {"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:39,bridge_name='br-int',has_traffic_filtering=True,id=f47f5f90-3725-47e3-a576-90bce6f62f7f,network=Network(62c40656-2bcc-4d32-b16e-b464500f89ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47f5f90-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG os_vif [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:39,bridge_name='br-int',has_traffic_filtering=True,id=f47f5f90-3725-47e3-a576-90bce6f62f7f,network=Network(62c40656-2bcc-4d32-b16e-b464500f89ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47f5f90-37') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44db5043-06e9-5d9c-a9f2-3fcb68900325', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf47f5f90-37, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf47f5f90-37, col_values=(('qos', UUID('8c34a999-4417-445d-8c3f-a858ca8501b0')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf47f5f90-37, col_values=(('external_ids', {'iface-id': 'f47f5f90-3725-47e3-a576-90bce6f62f7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:c1:39', 'vm-uuid': '9cc7b521-becf-40dc-bbef-fd6523e59b50'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:43 user nova-compute[75305]: INFO os_vif [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:39,bridge_name='br-int',has_traffic_filtering=True,id=f47f5f90-3725-47e3-a576-90bce6f62f7f,network=Network(62c40656-2bcc-4d32-b16e-b464500f89ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47f5f90-37')
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] No BDM found with device name sda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] No VIF found with MAC fa:16:3e:78:c1:39, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Using config drive
Nov 14 08:02:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Creating config drive at /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk.config
Nov 14 08:02:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpga94evbw {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpga94evbw" returned: 0 in 0.074s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG nova.network.neutron [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Updated VIF entry in instance network info cache for port f47f5f90-3725-47e3-a576-90bce6f62f7f. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG nova.network.neutron [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Updating instance_info_cache with network_info: [{"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a2e8488-e9b6-433f-b442-cf94fd99e420 req-30734dbb-362a-43bb-a9ee-732373ff44e7 service nova] Releasing lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Successfully updated port: 88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquired lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-changed-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Refreshing instance network info cache due to event network-changed-88edc6a5-9716-411e-8ea6-9da3cac488d0. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] Acquiring lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Releasing lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Instance network_info: |[{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] Acquired lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Refreshing network info cache for port 88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Start _get_guest_xml network_info=[{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:45 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:45 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converting VIF {"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=88edc6a5-9716-411e-8ea6-9da3cac488d0,network=Network(ed0901ec-8392-4a40-9a10-33cdb8f2e6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88edc6a5-97') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'pci_devices' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:45 user nova-compute[75305]:   <uuid>186a5286-ecc4-43e6-aea3-2529ddd72b58</uuid>
Nov 14 08:02:45 user nova-compute[75305]:   <name>instance-00000007</name>
Nov 14 08:02:45 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:45 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:45 user nova-compute[75305]:   <metadata>
Nov 14 08:02:45 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:45 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:45 user nova-compute[75305]:       <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:02:45 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:45</nova:creationTime>
Nov 14 08:02:45 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:45 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:45 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:45 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:45 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:45 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:45 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:45 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:45 user nova-compute[75305]:         <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:02:45 user nova-compute[75305]:         <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:02:45 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:45 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:02:45 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:45 user nova-compute[75305]:         <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:02:45 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:02:45 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:45 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:45 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:45 user nova-compute[75305]:   </metadata>
Nov 14 08:02:45 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:45 user nova-compute[75305]:     <system>
Nov 14 08:02:45 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:45 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:45 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:45 user nova-compute[75305]:       <entry name="serial">186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:02:45 user nova-compute[75305]:       <entry name="uuid">186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:02:45 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:45 user nova-compute[75305]:     </system>
Nov 14 08:02:45 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:45 user nova-compute[75305]:   <os>
Nov 14 08:02:45 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:45 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:45 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:45 user nova-compute[75305]:   </os>
Nov 14 08:02:45 user nova-compute[75305]:   <features>
Nov 14 08:02:45 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:45 user nova-compute[75305]:     <apic/>
Nov 14 08:02:45 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:45 user nova-compute[75305]:   </features>
Nov 14 08:02:45 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:45 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:45 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:45 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:45 user nova-compute[75305]:   </clock>
Nov 14 08:02:45 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:45 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:45 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:45 user nova-compute[75305]:   </cpu>
Nov 14 08:02:45 user nova-compute[75305]:   <devices>
Nov 14 08:02:45 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:45 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:45 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk"/>
Nov 14 08:02:45 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:02:45 user nova-compute[75305]:     </disk>
Nov 14 08:02:45 user nova-compute[75305]:     <disk type="file" device="cdrom">
Nov 14 08:02:45 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 08:02:45 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config"/>
Nov 14 08:02:45 user nova-compute[75305]:       <target dev="hda" bus="ide"/>
Nov 14 08:02:45 user nova-compute[75305]:     </disk>
Nov 14 08:02:45 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:45 user nova-compute[75305]:       <mac address="fa:16:3e:74:b6:cb"/>
Nov 14 08:02:45 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:45 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:45 user nova-compute[75305]:       <target dev="tap88edc6a5-97"/>
Nov 14 08:02:45 user nova-compute[75305]:     </interface>
Nov 14 08:02:45 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:45 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log" append="off"/>
Nov 14 08:02:45 user nova-compute[75305]:     </serial>
Nov 14 08:02:45 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:45 user nova-compute[75305]:     <video>
Nov 14 08:02:45 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:45 user nova-compute[75305]:     </video>
Nov 14 08:02:45 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:45 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:45 user nova-compute[75305]:     </rng>
Nov 14 08:02:45 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:45 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:45 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:45 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:45 user nova-compute[75305]:   </devices>
Nov 14 08:02:45 user nova-compute[75305]: </domain>
Nov 14 08:02:45 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converting VIF {"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=88edc6a5-9716-411e-8ea6-9da3cac488d0,network=Network(ed0901ec-8392-4a40-9a10-33cdb8f2e6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88edc6a5-97') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG os_vif [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=88edc6a5-9716-411e-8ea6-9da3cac488d0,network=Network(ed0901ec-8392-4a40-9a10-33cdb8f2e6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88edc6a5-97') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'feb463ef-87ee-5ef3-939c-7c92bde5d773', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88edc6a5-97, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88edc6a5-97, col_values=(('qos', UUID('d99518a9-8df9-43d2-b8af-278d8dd69730')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88edc6a5-97, col_values=(('external_ids', {'iface-id': '88edc6a5-9716-411e-8ea6-9da3cac488d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:b6:cb', 'vm-uuid': '186a5286-ecc4-43e6-aea3-2529ddd72b58'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:45 user nova-compute[75305]: INFO os_vif [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=88edc6a5-9716-411e-8ea6-9da3cac488d0,network=Network(ed0901ec-8392-4a40-9a10-33cdb8f2e6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88edc6a5-97')
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No BDM found with device name hda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No VIF found with MAC fa:16:3e:74:b6:cb, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:45 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Using config drive
Nov 14 08:02:46 user nova-compute[75305]: DEBUG nova.network.neutron [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updated VIF entry in instance network info cache for port 88edc6a5-9716-411e-8ea6-9da3cac488d0. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:46 user nova-compute[75305]: DEBUG nova.network.neutron [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Creating config drive at /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config
Nov 14 08:02:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprwpovt1y {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2906cc5d-c9c9-49d6-946e-cf89d4068f1b req-a3c83cbd-9d80-40ac-84cb-d989ef4d705a service nova] Releasing lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprwpovt1y" returned: 0 in 0.067s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-6bf51646-44e2-4b10-a753-2184eab3f2eb req-8ee30a4b-df94-41e5-b3b4-aef8c9a18dbd service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6bf51646-44e2-4b10-a753-2184eab3f2eb req-8ee30a4b-df94-41e5-b3b4-aef8c9a18dbd service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6bf51646-44e2-4b10-a753-2184eab3f2eb req-8ee30a4b-df94-41e5-b3b4-aef8c9a18dbd service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6bf51646-44e2-4b10-a753-2184eab3f2eb req-8ee30a4b-df94-41e5-b3b4-aef8c9a18dbd service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-6bf51646-44e2-4b10-a753-2184eab3f2eb req-8ee30a4b-df94-41e5-b3b4-aef8c9a18dbd service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:49 user nova-compute[75305]: WARNING nova.compute.manager [req-6bf51646-44e2-4b10-a753-2184eab3f2eb req-8ee30a4b-df94-41e5-b3b4-aef8c9a18dbd service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received unexpected event network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 for instance with vm_state building and task_state spawning.
Nov 14 08:02:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-510447fd-32c3-4a8e-9b07-52ffcb376000 req-8c9b541a-8732-4317-9700-8dfc7a138f1c service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Received event network-vif-plugged-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-510447fd-32c3-4a8e-9b07-52ffcb376000 req-8c9b541a-8732-4317-9700-8dfc7a138f1c service nova] Acquiring lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-510447fd-32c3-4a8e-9b07-52ffcb376000 req-8c9b541a-8732-4317-9700-8dfc7a138f1c service nova] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-510447fd-32c3-4a8e-9b07-52ffcb376000 req-8c9b541a-8732-4317-9700-8dfc7a138f1c service nova] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-510447fd-32c3-4a8e-9b07-52ffcb376000 req-8c9b541a-8732-4317-9700-8dfc7a138f1c service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] No waiting events found dispatching network-vif-plugged-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:50 user nova-compute[75305]: WARNING nova.compute.manager [req-510447fd-32c3-4a8e-9b07-52ffcb376000 req-8c9b541a-8732-4317-9700-8dfc7a138f1c service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Received unexpected event network-vif-plugged-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 for instance with vm_state active and task_state None.
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-8248de7b-b79f-437f-a63f-dd8987933d99 req-3a1944d1-892c-442b-95a6-2bd6cee2491d service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8248de7b-b79f-437f-a63f-dd8987933d99 req-3a1944d1-892c-442b-95a6-2bd6cee2491d service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8248de7b-b79f-437f-a63f-dd8987933d99 req-3a1944d1-892c-442b-95a6-2bd6cee2491d service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8248de7b-b79f-437f-a63f-dd8987933d99 req-3a1944d1-892c-442b-95a6-2bd6cee2491d service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-8248de7b-b79f-437f-a63f-dd8987933d99 req-3a1944d1-892c-442b-95a6-2bd6cee2491d service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:51 user nova-compute[75305]: WARNING nova.compute.manager [req-8248de7b-b79f-437f-a63f-dd8987933d99 req-3a1944d1-892c-442b-95a6-2bd6cee2491d service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received unexpected event network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 for instance with vm_state building and task_state spawning.
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:02:51 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Instance spawned successfully.
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:02:51 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Instance spawned successfully.
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:02:51 user nova-compute[75305]: INFO nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Took 10.44 seconds to spawn the instance on the hypervisor.
Nov 14 08:02:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:02:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:52 user nova-compute[75305]: INFO nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Took 13.68 seconds to spawn the instance on the hypervisor.
Nov 14 08:02:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:02:52 user nova-compute[75305]: INFO nova.compute.manager [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Took 12.60 seconds to build instance.
Nov 14 08:02:52 user nova-compute[75305]: INFO nova.compute.manager [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Took 14.83 seconds to build instance.
Nov 14 08:02:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9ddcf2a1-34cd-4b20-8cde-b5fc7ad03670 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.937s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-543f080a-cb5d-4ced-b5ba-25fd1fff2358 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.045s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:02:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:02:52 user nova-compute[75305]: INFO nova.compute.claims [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Claim successful on node user
Nov 14 08:02:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-59d4a280-3758-4fcd-938a-7610f39cc836 req-60395693-daf7-4389-baf5-02a316dbe546 service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Received event network-vif-plugged-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-59d4a280-3758-4fcd-938a-7610f39cc836 req-60395693-daf7-4389-baf5-02a316dbe546 service nova] Acquiring lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-59d4a280-3758-4fcd-938a-7610f39cc836 req-60395693-daf7-4389-baf5-02a316dbe546 service nova] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-59d4a280-3758-4fcd-938a-7610f39cc836 req-60395693-daf7-4389-baf5-02a316dbe546 service nova] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-59d4a280-3758-4fcd-938a-7610f39cc836 req-60395693-daf7-4389-baf5-02a316dbe546 service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] No waiting events found dispatching network-vif-plugged-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:53 user nova-compute[75305]: WARNING nova.compute.manager [req-59d4a280-3758-4fcd-938a-7610f39cc836 req-60395693-daf7-4389-baf5-02a316dbe546 service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Received unexpected event network-vif-plugged-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 for instance with vm_state active and task_state None.
Nov 14 08:02:53 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:02:53 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:02:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.092s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG nova.network.neutron [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:02:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:02:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG nova.policy [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2642005473594fb6b5025b9287badf37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddad3485d01c477c991081ef2824ebcb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:02:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Creating image(s)
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "/opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "/opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.026s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.256s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.260s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk 1073741824" returned: 0 in 0.076s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-3b4d4d52-a3c8-45eb-9993-6b450f408441 req-4f6fd265-4ae2-4f5f-add0-e15db53a1195 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3b4d4d52-a3c8-45eb-9993-6b450f408441 req-4f6fd265-4ae2-4f5f-add0-e15db53a1195 service nova] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3b4d4d52-a3c8-45eb-9993-6b450f408441 req-4f6fd265-4ae2-4f5f-add0-e15db53a1195 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3b4d4d52-a3c8-45eb-9993-6b450f408441 req-4f6fd265-4ae2-4f5f-add0-e15db53a1195 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-3b4d4d52-a3c8-45eb-9993-6b450f408441 req-4f6fd265-4ae2-4f5f-add0-e15db53a1195 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] No waiting events found dispatching network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:55 user nova-compute[75305]: WARNING nova.compute.manager [req-3b4d4d52-a3c8-45eb-9993-6b450f408441 req-4f6fd265-4ae2-4f5f-add0-e15db53a1195 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received unexpected event network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d for instance with vm_state active and task_state None.
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.226s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Successfully created port: ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Cannot resize image /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Ensure instance console log exists: /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.neutron [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Successfully updated port: ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquired lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.neutron [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-changed-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Refreshing instance network info cache due to event network-changed-ef83a02a-32fc-4d4b-8801-55bccce74380. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] Acquiring lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.neutron [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.neutron [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Updating instance_info_cache with network_info: [{"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Releasing lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Instance network_info: |[{"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] Acquired lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Refreshing network info cache for port ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Start _get_guest_xml network_info=[{"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:02:56 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:56 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-17695839',display_name='tempest-VolumesAssistedSnapshotsTest-server-17695839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-17695839',id=8,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6FpuGby8ca+THnEsjeTqhPHi/DyjrNVcJHxnJVs68tO8VNaKi4OGn2xeFF3teiZ/2lw082QMXd/2eQRzEZcu1ceihR/o81JP8ylKE9v1qJIE6p5R96oyf5D4mvh6Bgsg==',key_name='tempest-keypair-1507500110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddad3485d01c477c991081ef2824ebcb',ramdisk_id='',reservation_id='r-860rxtho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2056256375',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2056256375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2642005473594fb6b5025b9287badf37',uuid=0c6d8857-57c4-49da-8fd2-72b7bfacb8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Converting VIF {"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:71:0a,bridge_name='br-int',has_traffic_filtering=True,id=ef83a02a-32fc-4d4b-8801-55bccce74380,network=Network(3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef83a02a-32') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.objects.instance [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:02:56 user nova-compute[75305]:   <uuid>0c6d8857-57c4-49da-8fd2-72b7bfacb8c6</uuid>
Nov 14 08:02:56 user nova-compute[75305]:   <name>instance-00000008</name>
Nov 14 08:02:56 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:02:56 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:02:56 user nova-compute[75305]:   <metadata>
Nov 14 08:02:56 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:02:56 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:02:56 user nova-compute[75305]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-17695839</nova:name>
Nov 14 08:02:56 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:02:56</nova:creationTime>
Nov 14 08:02:56 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:02:56 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:02:56 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:02:56 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:02:56 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:02:56 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:02:56 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:02:56 user nova-compute[75305]:       <nova:owner>
Nov 14 08:02:56 user nova-compute[75305]:         <nova:user uuid="2642005473594fb6b5025b9287badf37">tempest-VolumesAssistedSnapshotsTest-2056256375-project-member</nova:user>
Nov 14 08:02:56 user nova-compute[75305]:         <nova:project uuid="ddad3485d01c477c991081ef2824ebcb">tempest-VolumesAssistedSnapshotsTest-2056256375</nova:project>
Nov 14 08:02:56 user nova-compute[75305]:       </nova:owner>
Nov 14 08:02:56 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:02:56 user nova-compute[75305]:       <nova:ports>
Nov 14 08:02:56 user nova-compute[75305]:         <nova:port uuid="ef83a02a-32fc-4d4b-8801-55bccce74380">
Nov 14 08:02:56 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 08:02:56 user nova-compute[75305]:         </nova:port>
Nov 14 08:02:56 user nova-compute[75305]:       </nova:ports>
Nov 14 08:02:56 user nova-compute[75305]:     </nova:instance>
Nov 14 08:02:56 user nova-compute[75305]:   </metadata>
Nov 14 08:02:56 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:02:56 user nova-compute[75305]:     <system>
Nov 14 08:02:56 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:02:56 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:02:56 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:02:56 user nova-compute[75305]:       <entry name="serial">0c6d8857-57c4-49da-8fd2-72b7bfacb8c6</entry>
Nov 14 08:02:56 user nova-compute[75305]:       <entry name="uuid">0c6d8857-57c4-49da-8fd2-72b7bfacb8c6</entry>
Nov 14 08:02:56 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:02:56 user nova-compute[75305]:     </system>
Nov 14 08:02:56 user nova-compute[75305]:   </sysinfo>
Nov 14 08:02:56 user nova-compute[75305]:   <os>
Nov 14 08:02:56 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:02:56 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:02:56 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:02:56 user nova-compute[75305]:   </os>
Nov 14 08:02:56 user nova-compute[75305]:   <features>
Nov 14 08:02:56 user nova-compute[75305]:     <acpi/>
Nov 14 08:02:56 user nova-compute[75305]:     <apic/>
Nov 14 08:02:56 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:02:56 user nova-compute[75305]:   </features>
Nov 14 08:02:56 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:02:56 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:02:56 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:02:56 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:02:56 user nova-compute[75305]:   </clock>
Nov 14 08:02:56 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:02:56 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:02:56 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:02:56 user nova-compute[75305]:   </cpu>
Nov 14 08:02:56 user nova-compute[75305]:   <devices>
Nov 14 08:02:56 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:02:56 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:02:56 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk"/>
Nov 14 08:02:56 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:02:56 user nova-compute[75305]:     </disk>
Nov 14 08:02:56 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:02:56 user nova-compute[75305]:       <mac address="fa:16:3e:85:71:0a"/>
Nov 14 08:02:56 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:56 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:02:56 user nova-compute[75305]:       <target dev="tapef83a02a-32"/>
Nov 14 08:02:56 user nova-compute[75305]:     </interface>
Nov 14 08:02:56 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:02:56 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/console.log" append="off"/>
Nov 14 08:02:56 user nova-compute[75305]:     </serial>
Nov 14 08:02:56 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:02:56 user nova-compute[75305]:     <video>
Nov 14 08:02:56 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:02:56 user nova-compute[75305]:     </video>
Nov 14 08:02:56 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:02:56 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:02:56 user nova-compute[75305]:     </rng>
Nov 14 08:02:56 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:02:56 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:02:56 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:02:56 user nova-compute[75305]:     </memballoon>
Nov 14 08:02:56 user nova-compute[75305]:   </devices>
Nov 14 08:02:56 user nova-compute[75305]: </domain>
Nov 14 08:02:56 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-17695839',display_name='tempest-VolumesAssistedSnapshotsTest-server-17695839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-17695839',id=8,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6FpuGby8ca+THnEsjeTqhPHi/DyjrNVcJHxnJVs68tO8VNaKi4OGn2xeFF3teiZ/2lw082QMXd/2eQRzEZcu1ceihR/o81JP8ylKE9v1qJIE6p5R96oyf5D4mvh6Bgsg==',key_name='tempest-keypair-1507500110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ddad3485d01c477c991081ef2824ebcb',ramdisk_id='',reservation_id='r-860rxtho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2056256375',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2056256375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2642005473594fb6b5025b9287badf37',uuid=0c6d8857-57c4-49da-8fd2-72b7bfacb8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Converting VIF {"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:71:0a,bridge_name='br-int',has_traffic_filtering=True,id=ef83a02a-32fc-4d4b-8801-55bccce74380,network=Network(3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef83a02a-32') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG os_vif [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:71:0a,bridge_name='br-int',has_traffic_filtering=True,id=ef83a02a-32fc-4d4b-8801-55bccce74380,network=Network(3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef83a02a-32') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10e2c8fb-4a0e-53fb-8ec2-7156c7ae88fd', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef83a02a-32, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef83a02a-32, col_values=(('qos', UUID('1c2c0d9c-f193-4d77-b4d2-af973c6f1252')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef83a02a-32, col_values=(('external_ids', {'iface-id': 'ef83a02a-32fc-4d4b-8801-55bccce74380', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:71:0a', 'vm-uuid': '0c6d8857-57c4-49da-8fd2-72b7bfacb8c6'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:56 user nova-compute[75305]: INFO os_vif [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:71:0a,bridge_name='br-int',has_traffic_filtering=True,id=ef83a02a-32fc-4d4b-8801-55bccce74380,network=Network(3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef83a02a-32')
Nov 14 08:02:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] No VIF found with MAC fa:16:3e:85:71:0a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] No waiting events found dispatching network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:57 user nova-compute[75305]: WARNING nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received unexpected event network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d for instance with vm_state active and task_state None.
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:57 user nova-compute[75305]: WARNING nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state active and task_state None.
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:57 user nova-compute[75305]: WARNING nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state active and task_state None.
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] No waiting events found dispatching network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:57 user nova-compute[75305]: WARNING nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received unexpected event network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f for instance with vm_state active and task_state None.
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] No waiting events found dispatching network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:57 user nova-compute[75305]: WARNING nova.compute.manager [req-75dcc570-e163-4589-8fbe-79e20476a884 req-17d4448a-add3-496f-b320-1f3b26c48692 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received unexpected event network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f for instance with vm_state active and task_state None.
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.network.neutron [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Updated VIF entry in instance network info cache for port ef83a02a-32fc-4d4b-8801-55bccce74380. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG nova.network.neutron [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Updating instance_info_cache with network_info: [{"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:02:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5fac75-fd18-4582-9358-a58ab108eb96 req-88625b47-877c-45ea-8175-950f5aef41bd service nova] Releasing lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:58 user nova-compute[75305]: WARNING nova.compute.manager [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state active and task_state None.
Nov 14 08:02:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:58 user nova-compute[75305]: WARNING nova.compute.manager [req-8453a6db-134e-4e47-84c0-38c837b6faf6 req-4c86679b-0e9a-4e12-8f76-3097a40e99db service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state active and task_state None.
Nov 14 08:02:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:02:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-0328f5d1-6bcb-41db-a017-7af4b9c5e142 req-9d2227c5-0113-4781-98b0-f1b9716602c7 service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:02:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0328f5d1-6bcb-41db-a017-7af4b9c5e142 req-9d2227c5-0113-4781-98b0-f1b9716602c7 service nova] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:02:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0328f5d1-6bcb-41db-a017-7af4b9c5e142 req-9d2227c5-0113-4781-98b0-f1b9716602c7 service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:02:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0328f5d1-6bcb-41db-a017-7af4b9c5e142 req-9d2227c5-0113-4781-98b0-f1b9716602c7 service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:02:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-0328f5d1-6bcb-41db-a017-7af4b9c5e142 req-9d2227c5-0113-4781-98b0-f1b9716602c7 service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] No waiting events found dispatching network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:02:59 user nova-compute[75305]: WARNING nova.compute.manager [req-0328f5d1-6bcb-41db-a017-7af4b9c5e142 req-9d2227c5-0113-4781-98b0-f1b9716602c7 service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received unexpected event network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 for instance with vm_state building and task_state spawning.
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:03:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Instance spawned successfully.
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:01 user nova-compute[75305]: INFO nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Took 7.04 seconds to spawn the instance on the hypervisor.
Nov 14 08:03:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:03:01 user nova-compute[75305]: INFO nova.compute.manager [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Took 8.63 seconds to build instance.
Nov 14 08:03:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-51b8e265-f7c5-4bfb-87a1-da4e69786714 tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.873s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-1859d03a-6f70-4eb9-8774-02a4e634fd91 req-d1ad6ce2-4361-44ee-ab6c-24ca6464f12c service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1859d03a-6f70-4eb9-8774-02a4e634fd91 req-d1ad6ce2-4361-44ee-ab6c-24ca6464f12c service nova] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1859d03a-6f70-4eb9-8774-02a4e634fd91 req-d1ad6ce2-4361-44ee-ab6c-24ca6464f12c service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1859d03a-6f70-4eb9-8774-02a4e634fd91 req-d1ad6ce2-4361-44ee-ab6c-24ca6464f12c service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-1859d03a-6f70-4eb9-8774-02a4e634fd91 req-d1ad6ce2-4361-44ee-ab6c-24ca6464f12c service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] No waiting events found dispatching network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:02 user nova-compute[75305]: WARNING nova.compute.manager [req-1859d03a-6f70-4eb9-8774-02a4e634fd91 req-d1ad6ce2-4361-44ee-ab6c-24ca6464f12c service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received unexpected event network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 for instance with vm_state active and task_state None.
Nov 14 08:03:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:03:12 user nova-compute[75305]: INFO nova.compute.claims [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Claim successful on node user
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:03:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:03:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.policy [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa273fed7dfa49388ab3ca92f1061d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2fefab86d9b4003a2f1ea8035d28f3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:03:13 user nova-compute[75305]: INFO nova.virt.block_device [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Booting with volume 0b5f3219-e0d2-4184-8488-6a4795c69456 at /dev/vda
Nov 14 08:03:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:13 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:13 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7467MB free_disk=25.513957977294922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG os_brick.utils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:13 user nova-compute[75305]: INFO oslo.privsep.daemon [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6unur9a_/privsep.sock']
Nov 14 08:03:13 user sudo[86219]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6unur9a_/privsep.sock
Nov 14 08:03:13 user sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 08:03:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6dd11b5a-6147-4cd1-965a-19f75a091198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5959dc8-a417-4528-9f03-3951186c2315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:03:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.605s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.422s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:03:14 user nova-compute[75305]: INFO nova.compute.claims [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Claim successful on node user
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully created port: 70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully created port: e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:03:14 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:03:14 user nova-compute[75305]: INFO nova.virt.block_device [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Booting with volume 48f60536-b768-4936-82dd-2e41231e6f50 at /dev/vda
Nov 14 08:03:14 user nova-compute[75305]: DEBUG nova.policy [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fed94e69e6b44903998b824566f85db2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75bf7951de484ad6b5296e643847583a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:03:14 user nova-compute[75305]: DEBUG os_brick.utils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Skipping network cache update for instance because it is Building. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Skipping network cache update for instance because it is Building. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 08:03:15 user sudo[86219]: pam_unix(sudo:session): session closed for user root
Nov 14 08:03:15 user nova-compute[75305]: INFO oslo.privsep.daemon [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Spawned new privsep daemon via rootwrap
Nov 14 08:03:15 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 08:03:15 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 08:03:15 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 08:03:15 user nova-compute[75305]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86224
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[99991a58-3f7c-40d7-bcfb-051c6a2a6355]: (2,) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: WARNING oslo_privsep.priv_context [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] privsep daemon already running
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully created port: a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0cba8-fcd8-4d95-b858-a93566a33aec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.nvmeof [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1d4a4b-c602-4f4d-b22b-6ca40276cde9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:03:15 user nova-compute[75305]: INFO nova.compute.claims [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Claim successful on node user
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3d9cbc-9375-46c2-a502-2c00bffa1062]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73d5055-ba12-433f-a6ff-f9c197a2d481]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[903bdfd2-78e8-4a80-b550-ad62c8db7724]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2655c21f-57cb-4cc5-9b3e-3bdd55e10cbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fb0137-20d3-4c20-b52a-6190df45d8d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a70f78e-a596-4c1e-bb88-2df0f3e60452]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:15 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80abb91e-1bc1-4899-a778-ba453775823d]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.utils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== get_connector_properties: return (2080ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating existing volume attachment record: 6c3e84fb-f515-4af5-ac6c-c0067637a8db {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:15 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ac6260-002e-473c-9526-ecebe5263ba1]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG os_brick.utils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== get_connector_properties: return (628ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating existing volume attachment record: 4ac09786-eef7-4481-8e8c-c5954cca77c3 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully created port: 07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.481s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:03:16 user nova-compute[75305]: INFO nova.compute.claims [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Claim successful on node user
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:03:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully created port: bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.policy [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c331473d0aef488fa1dd92543749f50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45dc68f3d5354a06905843816164c441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully created port: 5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:03:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Creating image(s)
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "/opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "/opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "/opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.213s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.779s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:03:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.240s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully created port: a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk 1073741824" returned: 0 in 0.075s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:03:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Creating image(s)
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "/opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "/opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "/opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.policy [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec8ff38db0914074978d7af10d537059', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529f4831f7cb46c6961e4de5686cff3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully created port: 0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Cannot resize image /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Ensure instance console log exists: /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.205s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk 1073741824" returned: 0 in 0.059s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Successfully created port: 43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully created port: 67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:03:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Cannot resize image /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Ensure instance console log exists: /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully created port: 7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully updated port: 70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-70845bae-b029-4cfd-be13-cf8a87d11911. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.network.neutron [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port 70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully updated port: 07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-07ecf560-7926-48d7-a419-91293c5a8660. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port 07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Successfully created port: b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Successfully updated port: 43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquired lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a978d72f-a528-4cb4-a46a-8a760bc085be req-66fa71d2-6181-4780-88a8-dc11468b8ad2 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d5a386d-f14d-4d11-ab0a-850d8913a556 req-ffb608a3-a7dc-424f-84ea-109b760887ff service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updating instance_info_cache with network_info: [{"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Releasing lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Instance network_info: |[{"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Start _get_guest_xml network_info=[{"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:03:19 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:19 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2131009544',display_name='tempest-VolumesSnapshotTestJSON-instance-2131009544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2131009544',id=11,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV/jmqbK9vGERUBpcAKZXhjXryjZkO7DQWX6Zlu8Xtu/icfWXJ+BZmTP/nfBcsM+trGu7m1Lo7M4yStjjHxTdEd6ZGNI1z6JBoigcnDlOraoV22jeJ6SCs+vNzZaZW3w==',key_name='tempest-keypair-1091663583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45dc68f3d5354a06905843816164c441',ramdisk_id='',reservation_id='r-bh5nrg88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-109737474',owner_user_name='tempest-VolumesSnapshotTestJSON-109737474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c331473d0aef488fa1dd92543749f50e',uuid=91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converting VIF {"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=43bdf938-f392-40d2-9a72-46930577a7f0,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bdf938-f3') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'pci_devices' on Instance uuid 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:03:19 user nova-compute[75305]:   <uuid>91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a</uuid>
Nov 14 08:03:19 user nova-compute[75305]:   <name>instance-0000000b</name>
Nov 14 08:03:19 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:03:19 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:03:19 user nova-compute[75305]:   <metadata>
Nov 14 08:03:19 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:03:19 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:03:19 user nova-compute[75305]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2131009544</nova:name>
Nov 14 08:03:19 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:03:19</nova:creationTime>
Nov 14 08:03:19 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:03:19 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:03:19 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:03:19 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:03:19 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:03:19 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:03:19 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:03:19 user nova-compute[75305]:       <nova:owner>
Nov 14 08:03:19 user nova-compute[75305]:         <nova:user uuid="c331473d0aef488fa1dd92543749f50e">tempest-VolumesSnapshotTestJSON-109737474-project-member</nova:user>
Nov 14 08:03:19 user nova-compute[75305]:         <nova:project uuid="45dc68f3d5354a06905843816164c441">tempest-VolumesSnapshotTestJSON-109737474</nova:project>
Nov 14 08:03:19 user nova-compute[75305]:       </nova:owner>
Nov 14 08:03:19 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:03:19 user nova-compute[75305]:       <nova:ports>
Nov 14 08:03:19 user nova-compute[75305]:         <nova:port uuid="43bdf938-f392-40d2-9a72-46930577a7f0">
Nov 14 08:03:19 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 08:03:19 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:19 user nova-compute[75305]:       </nova:ports>
Nov 14 08:03:19 user nova-compute[75305]:     </nova:instance>
Nov 14 08:03:19 user nova-compute[75305]:   </metadata>
Nov 14 08:03:19 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:03:19 user nova-compute[75305]:     <system>
Nov 14 08:03:19 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:03:19 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:03:19 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:03:19 user nova-compute[75305]:       <entry name="serial">91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a</entry>
Nov 14 08:03:19 user nova-compute[75305]:       <entry name="uuid">91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a</entry>
Nov 14 08:03:19 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:03:19 user nova-compute[75305]:     </system>
Nov 14 08:03:19 user nova-compute[75305]:   </sysinfo>
Nov 14 08:03:19 user nova-compute[75305]:   <os>
Nov 14 08:03:19 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:03:19 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:03:19 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:03:19 user nova-compute[75305]:   </os>
Nov 14 08:03:19 user nova-compute[75305]:   <features>
Nov 14 08:03:19 user nova-compute[75305]:     <acpi/>
Nov 14 08:03:19 user nova-compute[75305]:     <apic/>
Nov 14 08:03:19 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:03:19 user nova-compute[75305]:   </features>
Nov 14 08:03:19 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:03:19 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:03:19 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:03:19 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:03:19 user nova-compute[75305]:   </clock>
Nov 14 08:03:19 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:03:19 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:03:19 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:03:19 user nova-compute[75305]:   </cpu>
Nov 14 08:03:19 user nova-compute[75305]:   <devices>
Nov 14 08:03:19 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:03:19 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:03:19 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk"/>
Nov 14 08:03:19 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:03:19 user nova-compute[75305]:     </disk>
Nov 14 08:03:19 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:19 user nova-compute[75305]:       <mac address="fa:16:3e:60:7b:bf"/>
Nov 14 08:03:19 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:19 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:19 user nova-compute[75305]:       <target dev="tap43bdf938-f3"/>
Nov 14 08:03:19 user nova-compute[75305]:     </interface>
Nov 14 08:03:19 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:03:19 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/console.log" append="off"/>
Nov 14 08:03:19 user nova-compute[75305]:     </serial>
Nov 14 08:03:19 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:03:19 user nova-compute[75305]:     <video>
Nov 14 08:03:19 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:19 user nova-compute[75305]:     </video>
Nov 14 08:03:19 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:03:19 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:03:19 user nova-compute[75305]:     </rng>
Nov 14 08:03:19 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:03:19 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:03:19 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:03:19 user nova-compute[75305]:     </memballoon>
Nov 14 08:03:19 user nova-compute[75305]:   </devices>
Nov 14 08:03:19 user nova-compute[75305]: </domain>
Nov 14 08:03:19 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2131009544',display_name='tempest-VolumesSnapshotTestJSON-instance-2131009544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2131009544',id=11,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV/jmqbK9vGERUBpcAKZXhjXryjZkO7DQWX6Zlu8Xtu/icfWXJ+BZmTP/nfBcsM+trGu7m1Lo7M4yStjjHxTdEd6ZGNI1z6JBoigcnDlOraoV22jeJ6SCs+vNzZaZW3w==',key_name='tempest-keypair-1091663583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45dc68f3d5354a06905843816164c441',ramdisk_id='',reservation_id='r-bh5nrg88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-109737474',owner_user_name='tempest-VolumesSnapshotTestJSON-109737474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c331473d0aef488fa1dd92543749f50e',uuid=91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converting VIF {"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=43bdf938-f392-40d2-9a72-46930577a7f0,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bdf938-f3') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG os_vif [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=43bdf938-f392-40d2-9a72-46930577a7f0,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bdf938-f3') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a19c68b0-4c68-5965-9298-e47ee1e04674', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43bdf938-f3, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43bdf938-f3, col_values=(('qos', UUID('44fd2cdd-0e20-4e9d-936d-bb48e42cde4d')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43bdf938-f3, col_values=(('external_ids', {'iface-id': '43bdf938-f392-40d2-9a72-46930577a7f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:7b:bf', 'vm-uuid': '91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:19 user nova-compute[75305]: INFO os_vif [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=43bdf938-f392-40d2-9a72-46930577a7f0,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bdf938-f3')
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No VIF found with MAC fa:16:3e:60:7b:bf, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully updated port: 848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-848a7a02-afae-41f9-a7d6-59cd81ffb56f. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port 848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully updated port: e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Successfully updated port: b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "refresh_cache-32a98fdb-39f7-496a-95f9-6bcd1606a2fe" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquired lock "refresh_cache-32a98fdb-39f7-496a-95f9-6bcd1606a2fe" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1f955e03-1f28-4677-81dd-f69167ac1cd7 req-bda33a13-3260-427e-811f-0db09a148817 service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:20 user nova-compute[75305]: INFO nova.virt.block_device [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Booting with volume ffccd15e-7e2d-4f3b-add1-f04394898248 at /dev/vdb
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.utils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[db531e3a-ea62-493d-92f1-948a40888a93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: INFO nova.virt.block_device [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Booting with volume d5677486-570c-4c75-b679-39a3d75036fe at /dev/vdb
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57f3bb-6a19-472b-a99b-aeee234e5903]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48cf2b9-b3aa-4cc4-918a-1f9c4669dd59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78d38de-e599-4870-97db-c7204952d8df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.utils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e50cb8-cdd6-4f9f-addd-7d2e71ad4399]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:20 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71550c3-5729-4c2f-8549-77b020ec469f]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.utils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating existing volume attachment record: 503c7702-2989-4191-b471-78205dc6db75 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08e9bcd-3ca3-46df-a2ae-83f63c5fa274]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbeb6dc-ff95-474a-b400-4f7102ccce26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2138c9b-e132-4f00-9f7f-258f1fd9af44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:20 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19e2169-b057-429e-8d58-c3fd0dc479be]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG os_brick.utils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating existing volume attachment record: 14c024db-e19c-404f-a21a-7ae447c5cacb {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Updating instance_info_cache with network_info: [{"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Releasing lock "refresh_cache-32a98fdb-39f7-496a-95f9-6bcd1606a2fe" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Instance network_info: |[{"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Start _get_guest_xml network_info=[{"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:03:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1237238910',display_name='tempest-VolumesNegativeTest-instance-1237238910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1237238910',id=12,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529f4831f7cb46c6961e4de5686cff3f',ramdisk_id='',reservation_id='r-oitcqh4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1979521520',owner_user_name='tempest-VolumesNegativeTest-1979521520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:17Z,user_data=None,user_id='ec8ff38db0914074978d7af10d537059',uuid=32a98fdb-39f7-496a-95f9-6bcd1606a2fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:20 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Converting VIF {"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:ab:d9,bridge_name='br-int',has_traffic_filtering=True,id=b0be203d-c34a-4c13-8705-f6efe37cba10,network=Network(5632be66-739d-47c0-8f62-ef73620a0227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0be203d-c3') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lazy-loading 'pci_devices' on Instance uuid 32a98fdb-39f7-496a-95f9-6bcd1606a2fe {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:03:21 user nova-compute[75305]:   <uuid>32a98fdb-39f7-496a-95f9-6bcd1606a2fe</uuid>
Nov 14 08:03:21 user nova-compute[75305]:   <name>instance-0000000c</name>
Nov 14 08:03:21 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:03:21 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:03:21 user nova-compute[75305]:   <metadata>
Nov 14 08:03:21 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:03:21 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:03:21 user nova-compute[75305]:       <nova:name>tempest-VolumesNegativeTest-instance-1237238910</nova:name>
Nov 14 08:03:21 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:03:20</nova:creationTime>
Nov 14 08:03:21 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:03:21 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:03:21 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:03:21 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:03:21 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:03:21 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:03:21 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:03:21 user nova-compute[75305]:       <nova:owner>
Nov 14 08:03:21 user nova-compute[75305]:         <nova:user uuid="ec8ff38db0914074978d7af10d537059">tempest-VolumesNegativeTest-1979521520-project-member</nova:user>
Nov 14 08:03:21 user nova-compute[75305]:         <nova:project uuid="529f4831f7cb46c6961e4de5686cff3f">tempest-VolumesNegativeTest-1979521520</nova:project>
Nov 14 08:03:21 user nova-compute[75305]:       </nova:owner>
Nov 14 08:03:21 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:03:21 user nova-compute[75305]:       <nova:ports>
Nov 14 08:03:21 user nova-compute[75305]:         <nova:port uuid="b0be203d-c34a-4c13-8705-f6efe37cba10">
Nov 14 08:03:21 user nova-compute[75305]:           <nova:ip type="fixed" address="192.168.233.173" ipVersion="4"/>
Nov 14 08:03:21 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:21 user nova-compute[75305]:       </nova:ports>
Nov 14 08:03:21 user nova-compute[75305]:     </nova:instance>
Nov 14 08:03:21 user nova-compute[75305]:   </metadata>
Nov 14 08:03:21 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:03:21 user nova-compute[75305]:     <system>
Nov 14 08:03:21 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:03:21 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:03:21 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:03:21 user nova-compute[75305]:       <entry name="serial">32a98fdb-39f7-496a-95f9-6bcd1606a2fe</entry>
Nov 14 08:03:21 user nova-compute[75305]:       <entry name="uuid">32a98fdb-39f7-496a-95f9-6bcd1606a2fe</entry>
Nov 14 08:03:21 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:03:21 user nova-compute[75305]:     </system>
Nov 14 08:03:21 user nova-compute[75305]:   </sysinfo>
Nov 14 08:03:21 user nova-compute[75305]:   <os>
Nov 14 08:03:21 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:03:21 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:03:21 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:03:21 user nova-compute[75305]:   </os>
Nov 14 08:03:21 user nova-compute[75305]:   <features>
Nov 14 08:03:21 user nova-compute[75305]:     <acpi/>
Nov 14 08:03:21 user nova-compute[75305]:     <apic/>
Nov 14 08:03:21 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:03:21 user nova-compute[75305]:   </features>
Nov 14 08:03:21 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:03:21 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:03:21 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:03:21 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:03:21 user nova-compute[75305]:   </clock>
Nov 14 08:03:21 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:03:21 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:03:21 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:03:21 user nova-compute[75305]:   </cpu>
Nov 14 08:03:21 user nova-compute[75305]:   <devices>
Nov 14 08:03:21 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:03:21 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:03:21 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk"/>
Nov 14 08:03:21 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:03:21 user nova-compute[75305]:     </disk>
Nov 14 08:03:21 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:21 user nova-compute[75305]:       <mac address="fa:16:3e:54:ab:d9"/>
Nov 14 08:03:21 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:21 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:21 user nova-compute[75305]:       <target dev="tapb0be203d-c3"/>
Nov 14 08:03:21 user nova-compute[75305]:     </interface>
Nov 14 08:03:21 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:03:21 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/console.log" append="off"/>
Nov 14 08:03:21 user nova-compute[75305]:     </serial>
Nov 14 08:03:21 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:03:21 user nova-compute[75305]:     <video>
Nov 14 08:03:21 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:21 user nova-compute[75305]:     </video>
Nov 14 08:03:21 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:03:21 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:03:21 user nova-compute[75305]:     </rng>
Nov 14 08:03:21 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:03:21 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:03:21 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:03:21 user nova-compute[75305]:     </memballoon>
Nov 14 08:03:21 user nova-compute[75305]:   </devices>
Nov 14 08:03:21 user nova-compute[75305]: </domain>
Nov 14 08:03:21 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1237238910',display_name='tempest-VolumesNegativeTest-instance-1237238910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1237238910',id=12,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='529f4831f7cb46c6961e4de5686cff3f',ramdisk_id='',reservation_id='r-oitcqh4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1979521520',owner_user_name='tempest-VolumesNegativeTest-1979521520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:17Z,user_data=None,user_id='ec8ff38db0914074978d7af10d537059',uuid=32a98fdb-39f7-496a-95f9-6bcd1606a2fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Converting VIF {"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:ab:d9,bridge_name='br-int',has_traffic_filtering=True,id=b0be203d-c34a-4c13-8705-f6efe37cba10,network=Network(5632be66-739d-47c0-8f62-ef73620a0227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0be203d-c3') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG os_vif [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ab:d9,bridge_name='br-int',has_traffic_filtering=True,id=b0be203d-c34a-4c13-8705-f6efe37cba10,network=Network(5632be66-739d-47c0-8f62-ef73620a0227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0be203d-c3') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '66d31356-37cf-5327-a3be-c152a4755f2a', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully updated port: b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0be203d-c3, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0be203d-c3, col_values=(('qos', UUID('d2834fbf-6f4d-4a59-957d-ba0ab6ed5080')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0be203d-c3, col_values=(('external_ids', {'iface-id': 'b0be203d-c34a-4c13-8705-f6efe37cba10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:ab:d9', 'vm-uuid': '32a98fdb-39f7-496a-95f9-6bcd1606a2fe'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: INFO os_vif [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ab:d9,bridge_name='br-int',has_traffic_filtering=True,id=b0be203d-c34a-4c13-8705-f6efe37cba10,network=Network(5632be66-739d-47c0-8f62-ef73620a0227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0be203d-c3')
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] No VIF found with MAC fa:16:3e:54:ab:d9, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully updated port: 9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-changed-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Refreshing instance network info cache due to event network-changed-43bdf938-f392-40d2-9a72-46930577a7f0. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquiring lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquired lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Refreshing network info cache for port 43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-1307f267-0aa3-4172-91a9-0df368baa531 req-9b923583-2c48-42c1-b62f-15f826dedd59 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1307f267-0aa3-4172-91a9-0df368baa531 req-9b923583-2c48-42c1-b62f-15f826dedd59 service nova] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1307f267-0aa3-4172-91a9-0df368baa531 req-9b923583-2c48-42c1-b62f-15f826dedd59 service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1307f267-0aa3-4172-91a9-0df368baa531 req-9b923583-2c48-42c1-b62f-15f826dedd59 service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-1307f267-0aa3-4172-91a9-0df368baa531 req-9b923583-2c48-42c1-b62f-15f826dedd59 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] No waiting events found dispatching network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:21 user nova-compute[75305]: WARNING nova.compute.manager [req-1307f267-0aa3-4172-91a9-0df368baa531 req-9b923583-2c48-42c1-b62f-15f826dedd59 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received unexpected event network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 for instance with vm_state building and task_state spawning.
Nov 14 08:03:21 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully updated port: 5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-b9b49c6d-8100-47af-8133-736ba3e1bde2. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updated VIF entry in instance network info cache for port 43bdf938-f392-40d2-9a72-46930577a7f0. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updating instance_info_cache with network_info: [{"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Releasing lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-e5d10339-70e7-42b6-9a02-9a4b4c59b845. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-5f93709c-024d-4406-bf37-8db387c5a6e8. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port 5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully updated port: a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully updated port: e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5ebc1d32-8746-4d5a-b16f-f45ad8e6519e req-ff685189-e0b0-462b-b1f6-41d851cf9036 service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received event network-changed-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Refreshing instance network info cache due to event network-changed-b0be203d-c34a-4c13-8705-f6efe37cba10. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquiring lock "refresh_cache-32a98fdb-39f7-496a-95f9-6bcd1606a2fe" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquired lock "refresh_cache-32a98fdb-39f7-496a-95f9-6bcd1606a2fe" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Refreshing network info cache for port b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-e0b79350-e4fb-4c5f-919e-f29efceb386b. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully updated port: 67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-077552d8-5074-4dbe-8c6e-d2c305944a5c req-293a8750-6577-4d9a-9c12-9b8b9b464534 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e644f68-92ba-43fd-92c0-1db10cacc58c req-b125e48e-65ad-4a3d-b15b-aaa4bd43f928 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e644f68-92ba-43fd-92c0-1db10cacc58c req-b125e48e-65ad-4a3d-b15b-aaa4bd43f928 service nova] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e644f68-92ba-43fd-92c0-1db10cacc58c req-b125e48e-65ad-4a3d-b15b-aaa4bd43f928 service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e644f68-92ba-43fd-92c0-1db10cacc58c req-b125e48e-65ad-4a3d-b15b-aaa4bd43f928 service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e644f68-92ba-43fd-92c0-1db10cacc58c req-b125e48e-65ad-4a3d-b15b-aaa4bd43f928 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] No waiting events found dispatching network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:23 user nova-compute[75305]: WARNING nova.compute.manager [req-3e644f68-92ba-43fd-92c0-1db10cacc58c req-b125e48e-65ad-4a3d-b15b-aaa4bd43f928 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received unexpected event network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 for instance with vm_state building and task_state spawning.
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Updated VIF entry in instance network info cache for port b0be203d-c34a-4c13-8705-f6efe37cba10. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Updating instance_info_cache with network_info: [{"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Releasing lock "refresh_cache-32a98fdb-39f7-496a-95f9-6bcd1606a2fe" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-9b357b6e-c138-46c0-8fc3-5ab8d5e09709. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port 9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully updated port: a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-a4a1142a-6df6-43cb-ab40-73583596e249. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-de2fd75d-dc64-458e-9e58-7f80b783d927 req-866e4db6-63c4-4bd4-948a-bd1246d3df38 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Successfully updated port: 7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-67ab3e90-3507-4776-883c-8bb583491e1c. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port 67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully updated port: bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received event network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Acquiring lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] No waiting events found dispatching network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:25 user nova-compute[75305]: WARNING nova.compute.manager [req-ba20d62c-e61f-4c5f-9d9f-68742fc68838 req-0da46a5f-a58a-4f46-9f80-3544aaf8b88a service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received unexpected event network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 for instance with vm_state building and task_state spawning.
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:03:25 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Instance spawned successfully.
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Successfully updated port: 0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:25 user nova-compute[75305]: INFO nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Took 9.09 seconds to spawn the instance on the hypervisor.
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-bb47e777-8726-47e9-ad11-70af908c61b0. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:25 user nova-compute[75305]: INFO nova.compute.manager [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Took 10.45 seconds to build instance.
Nov 14 08:03:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df793249-8205-47f4-9cb5-adc3ea864334 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.576s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:03:25 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Instance spawned successfully.
Nov 14 08:03:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:26 user nova-compute[75305]: INFO nova.virt.block_device [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Booting with volume 5ae7754e-9b19-4359-ba45-4ee055d8b06e at /dev/vdc
Nov 14 08:03:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.network.neutron [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47e6cdd7-5a97-41ff-95f4-fafacfb55b1a req-f4576668-b1c5-4f8a-876d-862969422fc4 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.utils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: INFO nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Took 8.92 seconds to spawn the instance on the hypervisor.
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d97078-8da9-440d-b26c-dbf07060dbd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5d3b63-19de-4e56-b3a4-7b9ab71441ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0d7bd3-607a-468e-b228-1187d51019b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eae06c-882b-47a9-bc6c-76d2d9ab2b5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:26 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a070e834-2f91-4b7a-800d-83ff0f19af94]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.utils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating existing volume attachment record: 9ba15e40-6216-44c6-8bd6-52b622f70dde {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:03:26 user nova-compute[75305]: INFO nova.compute.manager [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Took 10.64 seconds to build instance.
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a9998a08-e214-4869-aa9b-504d4f81c871 tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.766s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received event network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] Acquiring lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] No waiting events found dispatching network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:26 user nova-compute[75305]: WARNING nova.compute.manager [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received unexpected event network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 for instance with vm_state active and task_state None.
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-7966bbc1-c5cf-4215-a0f0-39382b12dda7. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:26 user nova-compute[75305]: INFO nova.virt.block_device [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Booting with volume 1cd7f475-0e4e-4464-96be-db4080f6908e at /dev/vdc
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.utils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b890c0de-5856-47dc-9022-792f90952436]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfed611-410b-4781-8c17-5b23ea472ec1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[59106213-b0e1-48af-9cc8-34dff1699fda]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97cb9da-66ee-4987-b6c6-b71973e9cfaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:03:26 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:03:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ae6ea-559b-4e9f-93f8-d8c439ee69a9]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG os_brick.utils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:26 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating existing volume attachment record: e4a858c9-a1a8-4d88-897a-b88d68fa1e20 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG nova.network.neutron [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [{"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance network_info: |[{"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port 7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-0ee8e7e1-3696-4af5-9402-187894a1fe99. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updated VIF entry in instance network info cache for port 7966bbc1-c5cf-4215-a0f0-39382b12dda7. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:03:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [{"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4caed94-59f9-4765-8e20-10dec07f284f req-12d1e5e0-d0f3-4a5f-94cf-787212ac7892 service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [{"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance network_info: |[{"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port 0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updated VIF entry in instance network info cache for port 0ee8e7e1-3696-4af5-9402-187894a1fe99. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [{"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:03:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-33dbd499-cfbf-4688-9485-4b2ebb21bf9f req-0b75e46a-0d42-4622-a255-230c102fbd71 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:03:31 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Creating image(s)
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Ensure instance console log exists: /opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Start _get_guest_xml network_info=[{"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6c3e84fb-f515-4af5-ac6c-c0067637a8db', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlcaniHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f', 'attached_at': '', 'detached_at': '', 'volume_id': '0b5f3219-e0d2-4184-8488-6a4795c69456', 'serial': '0b5f3219-e0d2-4184-8488-6a4795c69456'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '503c7702-2989-4191-b471-78205dc6db75', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihtkaDZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffccd15e-7e2d-4f3b-add1-f04394898248', 'serial': 'ffccd15e-7e2d-4f3b-add1-f04394898248'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'attachment_id': '9ba15e40-6216-44c6-8bd6-52b622f70dde', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CftcSrXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f', 'attached_at': '', 'detached_at': '', 'volume_id': '5ae7754e-9b19-4359-ba45-4ee055d8b06e', 'serial': '5ae7754e-9b19-4359-ba45-4ee055d8b06e'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connector [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Factory for ISCSI on None {{(pid=75305) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlcaniHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:31 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:31 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:31 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4fdeca-5ceb-460c-afb1-74dad601902f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:03:31 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1e99cb-9233-4841-a818-bb4e3bc20ab9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456] added
Nov 14 08:03:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac738aab-f499-4079-b1ba-1daba1207e60]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2cb08f-f1d2-4986-a8c9-6f0b711d912d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlcaniHo {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlcaniHo" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dbafde-3392-4f5c-b6f2-5e7b9a29fcd9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RlcaniHo'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc8237-ab64-4748-ba87-bc2b71476b23]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b237a7-c59b-49aa-94c3-afe742334e01]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:03:31 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:03:31 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:31 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 08:03:31 user nova-compute[75305]: 
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f04c7d2-2523-4f80-8033-3de9157a6d2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260]
Nov 14 08:03:31 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260] successful.
Nov 14 08:03:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c79460-dbdb-4729-904e-71fcbf9ee714]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf085c-4fd7-4c0b-b3ae-6ba16d027a31]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[054edc90-c305-4680-b4c6-a95eae863247]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlcaniHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:03:31 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Creating image(s)
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Ensure instance console log exists: /opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Start _get_guest_xml network_info=[{"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '4ac09786-eef7-4481-8e8c-c5954cca77c3', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POblDGeZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2', 'attached_at': '', 'detached_at': '', 'volume_id': '48f60536-b768-4936-82dd-2e41231e6f50', 'serial': '48f60536-b768-4936-82dd-2e41231e6f50'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 1, 'attachment_id': '14c024db-e19c-404f-a21a-7ae447c5cacb', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awuhOCJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2', 'attached_at': '', 'detached_at': '', 'volume_id': 'd5677486-570c-4c75-b679-39a3d75036fe', 'serial': 'd5677486-570c-4c75-b679-39a3d75036fe'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'boot_index': 2, 'attachment_id': 'e4a858c9-a1a8-4d88-897a-b88d68fa1e20', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQFlKRxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2', 'attached_at': '', 'detached_at': '', 'volume_id': '1cd7f475-0e4e-4464-96be-db4080f6908e', 'serial': '1cd7f475-0e4e-4464-96be-db4080f6908e'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:03:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POblDGeZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:31 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23531633731366433', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531633731366433', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.634s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:32 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fe62c0-2822-493f-838a-6689582b586c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:03:32 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihtkaDZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d7605-a9a0-4d08-9939-a4e4c4c35ed3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50] added
Nov 14 08:03:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a151c928-a091-405c-99cd-26c6429095fb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9384a842-8be7-4729-b977-2b19dcbf84f9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v POblDGeZ {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v POblDGeZ" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d406d455-1da7-4c29-aef8-658743e51aca]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'POblDGeZ'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[34072f33-e558-4ae9-b1b9-7859ed2e763b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df87cb-e53b-4671-9f62-21e4b7f0c740]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6532b195-8831-497a-83e3-1cbc66fdbc14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260]
Nov 14 08:03:32 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260] successful.
Nov 14 08:03:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b27a45-234f-4e88-8dcc-2a8fece2fa2f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9686c6-dc16-4a67-96d7-d5020c5ab3ff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:32 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:32 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63f47d8-3c67-469e-a961-dea069d62aab]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POblDGeZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== connect_volume: return (1924ms) {'type': 'block', 'scsi_wwn': '23639393833626132', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639393833626132', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.258s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:33 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:33 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b2172-9ada-4781-8573-e68cb369ff01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:03:33 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awuhOCJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:33 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[195ab004-315a-49ce-80bf-4eb9e928836e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248] added
Nov 14 08:03:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4889c1a8-eab7-41f6-bd26-40dbe2cdded4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[239afa15-1adb-4cc6-8af4-de2caff337e5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihtkaDZy {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihtkaDZy" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777f8f0-b128-4d42-91d1-e81d74b18318]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ihtkaDZy'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bf2262-700b-4a33-96bf-5a09fad675ad]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af1494e-a18d-4b95-95a2-8e5b6177a3e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d39f391-d7be-4308-99f0-44fd9832cd08]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260]
Nov 14 08:03:33 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260] successful.
Nov 14 08:03:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[029926fa-573d-4f8c-9d9b-6a04f699c1d4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f44b6-dd90-4340-8178-d8210742b126]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:03:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7095c171-b2da-45df-9bfe-a14609f46e3a]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihtkaDZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== connect_volume: return (2559ms) {'type': 'block', 'scsi_wwn': '23565646161383763', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565646161383763', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.255s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:35 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:35 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b964de-0160-42ec-baaf-3bf0c9691207]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:03:35 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CftcSrXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:35 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff25453-1443-442f-acc1-345b3ca22db6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe] added
Nov 14 08:03:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[104afd93-b5b1-470b-8dbf-6a28429512f2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[168c43e4-35cc-431e-9079-2d16c7a68966]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awuhOCJX {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awuhOCJX" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f025a4-6110-4319-b56c-bad5eb52e652]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awuhOCJX'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[922f7086-2ab8-4081-8efd-2ef4f0e10a0c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15d46ea-993b-4992-ac28-b1355c4796dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2015548e-3111-476d-8339-5f04e89387d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260]
Nov 14 08:03:35 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260] successful.
Nov 14 08:03:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff25d77e-f489-4710-b82a-864e67bdf433]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a241a823-4dcb-42a3-855a-cf503aadbe0c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:35 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2ff6e9-e676-46a1-9adb-2a2f050067b0]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awuhOCJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== connect_volume: return (2539ms) {'type': 'block', 'scsi_wwn': '26465633263353431', 'path': '/dev/sde'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465633263353431', 'path': '/dev/sde'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.256s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:36 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:36 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQFlKRxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:03:36 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c311c0a8-48c8-491d-b4ed-b304b7c412f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:03:36 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e08ef5d-476a-4699-ac47-11e6ad42e6e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e] added
Nov 14 08:03:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7af138-22fa-4a79-b813-5970a9435808]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[098310c6-554f-46c5-9282-cba714cda07d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CftcSrXT {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CftcSrXT" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d223206-557f-4c22-be8d-ced285658c15]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CftcSrXT'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf4fd01-d484-4b26-b3e8-034752508021]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170f1f1-b574-435f-842f-f536d0a4fa2a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf29c54e-bca9-44b3-b5ce-225ffb842b12]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260]
Nov 14 08:03:36 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260] successful.
Nov 14 08:03:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f0c901-c481-431f-ae05-3812cbd650c4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad82662-d8b7-4657-b4f5-cc9e758efc60]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:03:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:36 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:03:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe577347-5b14-4970-acf0-1f5049363b8e]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CftcSrXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== connect_volume: return (2622ms) {'type': 'block', 'scsi_wwn': '23266326263323963', 'path': '/dev/sdf'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266326263323963', 'path': '/dev/sdf'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.332s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:37 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:03:37 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a7dfc8-c625-4816-9d08-af1463aa7e82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:03:37 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:72:91,bridge_name='br-int',has_traffic_filtering=True,id=70845bae-b029-4cfd-be13-cf8a87d11911,network=Network(68640d53-8d65-494d-a493-34c5e4ade60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70845bae-b0') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:00,bridge_name='br-int',has_traffic_filtering=True,id=e5d10339-70e7-42b6-9a02-9a4b4c59b845,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5d10339-70') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1e:0d,bridge_name='br-int',has_traffic_filtering=True,id=9b357b6e-c138-46c0-8fc3-5ab8d5e09709,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b357b6e-c1') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:8e:c6,bridge_name='br-int',has_traffic_filtering=True,id=e0b79350-e4fb-4c5f-919e-f29efceb386b,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b79350-e4') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7afc5aa-63') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:43:8f,bridge_name='br-int',has_traffic_filtering=True,id=bb47e777-8726-47e9-ad11-70af908c61b0,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47e777-87') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:22:81,bridge_name='br-int',has_traffic_filtering=True,id=0ee8e7e1-3696-4af5-9402-187894a1fe99,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee8e7e1-36') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc2b9e3-09ff-41eb-b1b7-14dd15f0b13b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e] added
Nov 14 08:03:37 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:03:37 user nova-compute[75305]:   <uuid>6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f</uuid>
Nov 14 08:03:37 user nova-compute[75305]:   <name>instance-00000009</name>
Nov 14 08:03:37 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:03:37 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:03:37 user nova-compute[75305]:   <metadata>
Nov 14 08:03:37 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:03:37 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:03:37 user nova-compute[75305]:       <nova:name>tempest-device-tagging-server-1709220993</nova:name>
Nov 14 08:03:37 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:03:31</nova:creationTime>
Nov 14 08:03:37 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:03:37 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:03:37 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:03:37 user nova-compute[75305]:       <nova:owner>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:user uuid="aa273fed7dfa49388ab3ca92f1061d18">tempest-TaggedBootDevicesTest_v242-1568364879-project-member</nova:user>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:project uuid="e2fefab86d9b4003a2f1ea8035d28f3b">tempest-TaggedBootDevicesTest_v242-1568364879</nova:project>
Nov 14 08:03:37 user nova-compute[75305]:       </nova:owner>
Nov 14 08:03:37 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:03:37 user nova-compute[75305]:       <nova:ports>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:port uuid="70845bae-b029-4cfd-be13-cf8a87d11911">
Nov 14 08:03:37 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 08:03:37 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:port uuid="e5d10339-70e7-42b6-9a02-9a4b4c59b845">
Nov 14 08:03:37 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
Nov 14 08:03:37 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:port uuid="9b357b6e-c138-46c0-8fc3-5ab8d5e09709">
Nov 14 08:03:37 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Nov 14 08:03:37 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:port uuid="e0b79350-e4fb-4c5f-919e-f29efceb386b">
Nov 14 08:03:37 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.233" ipVersion="4"/>
Nov 14 08:03:37 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:port uuid="a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8">
Nov 14 08:03:37 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.179" ipVersion="4"/>
Nov 14 08:03:37 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:port uuid="bb47e777-8726-47e9-ad11-70af908c61b0">
Nov 14 08:03:37 user nova-compute[75305]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 08:03:37 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:37 user nova-compute[75305]:         <nova:port uuid="0ee8e7e1-3696-4af5-9402-187894a1fe99">
Nov 14 08:03:37 user nova-compute[75305]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 08:03:37 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:37 user nova-compute[75305]:       </nova:ports>
Nov 14 08:03:37 user nova-compute[75305]:     </nova:instance>
Nov 14 08:03:37 user nova-compute[75305]:   </metadata>
Nov 14 08:03:37 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:03:37 user nova-compute[75305]:     <system>
Nov 14 08:03:37 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:03:37 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:03:37 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:03:37 user nova-compute[75305]:       <entry name="serial">6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f</entry>
Nov 14 08:03:37 user nova-compute[75305]:       <entry name="uuid">6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f</entry>
Nov 14 08:03:37 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:03:37 user nova-compute[75305]:     </system>
Nov 14 08:03:37 user nova-compute[75305]:   </sysinfo>
Nov 14 08:03:37 user nova-compute[75305]:   <os>
Nov 14 08:03:37 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:03:37 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:03:37 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:03:37 user nova-compute[75305]:   </os>
Nov 14 08:03:37 user nova-compute[75305]:   <features>
Nov 14 08:03:37 user nova-compute[75305]:     <acpi/>
Nov 14 08:03:37 user nova-compute[75305]:     <apic/>
Nov 14 08:03:37 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:03:37 user nova-compute[75305]:   </features>
Nov 14 08:03:37 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:03:37 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:03:37 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:03:37 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:03:37 user nova-compute[75305]:   </clock>
Nov 14 08:03:37 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:03:37 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:03:37 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:03:37 user nova-compute[75305]:   </cpu>
Nov 14 08:03:37 user nova-compute[75305]:   <devices>
Nov 14 08:03:37 user nova-compute[75305]:     <disk type="file" device="cdrom">
Nov 14 08:03:37 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 08:03:37 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f/disk.config"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="hda" bus="ide"/>
Nov 14 08:03:37 user nova-compute[75305]:     </disk>
Nov 14 08:03:37 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:03:37 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:03:37 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <serial>0b5f3219-e0d2-4184-8488-6a4795c69456</serial>
Nov 14 08:03:37 user nova-compute[75305]:     </disk>
Nov 14 08:03:37 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:03:37 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:03:37 user nova-compute[75305]:       <source dev="/dev/sdd"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <serial>ffccd15e-7e2d-4f3b-add1-f04394898248</serial>
Nov 14 08:03:37 user nova-compute[75305]:     </disk>
Nov 14 08:03:37 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:03:37 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:03:37 user nova-compute[75305]:       <source dev="/dev/sdf"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="vdc" bus="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <serial>5ae7754e-9b19-4359-ba45-4ee055d8b06e</serial>
Nov 14 08:03:37 user nova-compute[75305]:     </disk>
Nov 14 08:03:37 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:37 user nova-compute[75305]:       <mac address="fa:16:3e:63:72:91"/>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="tap70845bae-b0"/>
Nov 14 08:03:37 user nova-compute[75305]:     </interface>
Nov 14 08:03:37 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:37 user nova-compute[75305]:       <mac address="fa:16:3e:6f:70:00"/>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="tape5d10339-70"/>
Nov 14 08:03:37 user nova-compute[75305]:     </interface>
Nov 14 08:03:37 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:37 user nova-compute[75305]:       <mac address="fa:16:3e:00:1e:0d"/>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="tap9b357b6e-c1"/>
Nov 14 08:03:37 user nova-compute[75305]:     </interface>
Nov 14 08:03:37 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:37 user nova-compute[75305]:       <mac address="fa:16:3e:1f:8e:c6"/>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="tape0b79350-e4"/>
Nov 14 08:03:37 user nova-compute[75305]:     </interface>
Nov 14 08:03:37 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:37 user nova-compute[75305]:       <mac address="fa:16:3e:42:24:ad"/>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="tapa7afc5aa-63"/>
Nov 14 08:03:37 user nova-compute[75305]:     </interface>
Nov 14 08:03:37 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:37 user nova-compute[75305]:       <mac address="fa:16:3e:65:43:8f"/>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="tapbb47e777-87"/>
Nov 14 08:03:37 user nova-compute[75305]:     </interface>
Nov 14 08:03:37 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:37 user nova-compute[75305]:       <mac address="fa:16:3e:30:22:81"/>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:37 user nova-compute[75305]:       <target dev="tap0ee8e7e1-36"/>
Nov 14 08:03:37 user nova-compute[75305]:     </interface>
Nov 14 08:03:37 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:03:37 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f/console.log" append="off"/>
Nov 14 08:03:37 user nova-compute[75305]:     </serial>
Nov 14 08:03:37 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:03:37 user nova-compute[75305]:     <video>
Nov 14 08:03:37 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:37 user nova-compute[75305]:     </video>
Nov 14 08:03:37 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:03:37 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:03:37 user nova-compute[75305]:     </rng>
Nov 14 08:03:37 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:03:37 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:03:37 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:03:37 user nova-compute[75305]:     </memballoon>
Nov 14 08:03:37 user nova-compute[75305]:   </devices>
Nov 14 08:03:37 user nova-compute[75305]: </domain>
Nov 14 08:03:37 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:72:91,bridge_name='br-int',has_traffic_filtering=True,id=70845bae-b029-4cfd-be13-cf8a87d11911,network=Network(68640d53-8d65-494d-a493-34c5e4ade60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70845bae-b0') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:72:91,bridge_name='br-int',has_traffic_filtering=True,id=70845bae-b029-4cfd-be13-cf8a87d11911,network=Network(68640d53-8d65-494d-a493-34c5e4ade60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70845bae-b0') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '340defa4-aac0-5cef-9ec8-b660e4cbc165', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b55bf30-944b-48b8-bd0d-0b3ad0ca9662]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70845bae-b0, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70845bae-b0, col_values=(('qos', UUID('282ef213-8370-442e-b930-da43fe858d86')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70845bae-b0, col_values=(('external_ids', {'iface-id': '70845bae-b029-4cfd-be13-cf8a87d11911', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:72:91', 'vm-uuid': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: INFO os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:72:91,bridge_name='br-int',has_traffic_filtering=True,id=70845bae-b029-4cfd-be13-cf8a87d11911,network=Network(68640d53-8d65-494d-a493-34c5e4ade60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70845bae-b0')
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:00,bridge_name='br-int',has_traffic_filtering=True,id=e5d10339-70e7-42b6-9a02-9a4b4c59b845,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5d10339-70') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:00,bridge_name='br-int',has_traffic_filtering=True,id=e5d10339-70e7-42b6-9a02-9a4b4c59b845,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5d10339-70') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03d990-53c2-4f8e-9ba0-b30cd91d726d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff6b5a2b-2d06-5b1e-b651-5213bfe7271c', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQFlKRxp {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZQFlKRxp" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27ae31f-65d5-42c1-9798-e8f0d15e28d9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZQFlKRxp'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5d10339-70, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5d10339-70, col_values=(('qos', UUID('df1ed355-6b90-4773-bc32-77f61ced4d9b')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5d10339-70, col_values=(('external_ids', {'iface-id': 'e5d10339-70e7-42b6-9a02-9a4b4c59b845', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:70:00', 'vm-uuid': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[888442b5-889c-4a93-a60c-77430f8c0eab]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: INFO os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:00,bridge_name='br-int',has_traffic_filtering=True,id=e5d10339-70e7-42b6-9a02-9a4b4c59b845,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5d10339-70')
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1e:0d,bridge_name='br-int',has_traffic_filtering=True,id=9b357b6e-c138-46c0-8fc3-5ab8d5e09709,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b357b6e-c1') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1e:0d,bridge_name='br-int',has_traffic_filtering=True,id=9b357b6e-c138-46c0-8fc3-5ab8d5e09709,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b357b6e-c1') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '084334bd-01fb-5c1f-a1c0-c1e2213c0a02', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77586799-af0c-488f-86cc-48ac06a3d78b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:03:37 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:37 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:03:37 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b357b6e-c1, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b357b6e-c1, col_values=(('qos', UUID('42e7ef48-7b8d-4da8-9e9d-5ed7c13cddc5')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b357b6e-c1, col_values=(('external_ids', {'iface-id': '9b357b6e-c138-46c0-8fc3-5ab8d5e09709', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:1e:0d', 'vm-uuid': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: INFO os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1e:0d,bridge_name='br-int',has_traffic_filtering=True,id=9b357b6e-c138-46c0-8fc3-5ab8d5e09709,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b357b6e-c1')
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:8e:c6,bridge_name='br-int',has_traffic_filtering=True,id=e0b79350-e4fb-4c5f-919e-f29efceb386b,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b79350-e4') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:8e:c6,bridge_name='br-int',has_traffic_filtering=True,id=e0b79350-e4fb-4c5f-919e-f29efceb386b,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b79350-e4') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c10f1c5-8e8e-5179-ab35-63b765b8da96', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df8295d-5b60-4c88-adf1-cf3f7a6654d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260]
Nov 14 08:03:37 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260] successful.
Nov 14 08:03:37 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0b79350-e4, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0b79350-e4, col_values=(('qos', UUID('568c3372-97d0-48c6-a087-a4da6c644bfd')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0b79350-e4, col_values=(('external_ids', {'iface-id': 'e0b79350-e4fb-4c5f-919e-f29efceb386b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:8e:c6', 'vm-uuid': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.070s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f9cf5f-dd1c-47e7-9065-08e8b1c17efb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: INFO os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:8e:c6,bridge_name='br-int',has_traffic_filtering=True,id=e0b79350-e4fb-4c5f-919e-f29efceb386b,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b79350-e4')
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7afc5aa-63') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7afc5aa-63') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b893c-0305-4acf-bc4b-26518bde0d7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:03:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:03:38 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:03:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e21b2377-a7cc-58d2-898c-ab42f12f4cc2', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76402cd-9594-4158-a798-0b9fa5de683a]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7afc5aa-63, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7afc5aa-63, col_values=(('qos', UUID('39872794-a1a7-4948-b7c9-65ec56b0e701')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7afc5aa-63, col_values=(('external_ids', {'iface-id': 'a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:24:ad', 'vm-uuid': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: INFO os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7afc5aa-63')
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:43:8f,bridge_name='br-int',has_traffic_filtering=True,id=bb47e777-8726-47e9-ad11-70af908c61b0,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47e777-87') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:43:8f,bridge_name='br-int',has_traffic_filtering=True,id=bb47e777-8726-47e9-ad11-70af908c61b0,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47e777-87') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '074f681d-622f-58f8-b0df-2609852b1a3a', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb47e777-87, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb47e777-87, col_values=(('qos', UUID('62dc9656-12c6-4d4a-bd84-a4b81b8444f0')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb47e777-87, col_values=(('external_ids', {'iface-id': 'bb47e777-8726-47e9-ad11-70af908c61b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:43:8f', 'vm-uuid': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: INFO os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:43:8f,bridge_name='br-int',has_traffic_filtering=True,id=bb47e777-8726-47e9-ad11-70af908c61b0,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47e777-87')
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:22:81,bridge_name='br-int',has_traffic_filtering=True,id=0ee8e7e1-3696-4af5-9402-187894a1fe99,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee8e7e1-36') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:22:81,bridge_name='br-int',has_traffic_filtering=True,id=0ee8e7e1-3696-4af5-9402-187894a1fe99,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee8e7e1-36') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25d4c122-817a-5045-a47b-d4e8426cb495', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ee8e7e1-36, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ee8e7e1-36, col_values=(('qos', UUID('6d814948-1c52-405b-8ef7-d6f56ae258af')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ee8e7e1-36, col_values=(('external_ids', {'iface-id': '0ee8e7e1-3696-4af5-9402-187894a1fe99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:22:81', 'vm-uuid': '6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:38 user nova-compute[75305]: INFO os_vif [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:22:81,bridge_name='br-int',has_traffic_filtering=True,id=0ee8e7e1-3696-4af5-9402-187894a1fe99,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee8e7e1-36')
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] No BDM found with device name hda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] No VIF found with MAC fa:16:3e:63:72:91, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] No VIF found with MAC fa:16:3e:42:24:ad, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:03:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Using config drive
Nov 14 08:03:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Creating config drive at /opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f/disk.config
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsvct0cy0 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsvct0cy0" returned: 0 in 0.054s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQFlKRxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== connect_volume: return (2749ms) {'type': 'block', 'scsi_wwn': '26564333266313739', 'path': '/dev/sdg'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564333266313739', 'path': '/dev/sdg'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:2e:24,bridge_name='br-int',has_traffic_filtering=True,id=07ecf560-7926-48d7-a419-91293c5a8660,network=Network(a773e639-a8dc-426b-97f6-b6325f50e56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ecf560-79') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:0a:3d,bridge_name='br-int',has_traffic_filtering=True,id=848a7a02-afae-41f9-a7d6-59cd81ffb56f,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap848a7a02-af') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=b9b49c6d-8100-47af-8133-736ba3e1bde2,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9b49c6d-81') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:95:ae,bridge_name='br-int',has_traffic_filtering=True,id=5f93709c-024d-4406-bf37-8db387c5a6e8,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f93709c-02') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:29:78,bridge_name='br-int',has_traffic_filtering=True,id=a4a1142a-6df6-43cb-ab40-73583596e249,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a1142a-6d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:bb:d2,bridge_name='br-int',has_traffic_filtering=True,id=67ab3e90-3507-4776-883c-8bb583491e1c,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab3e90-35') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:fa:93,bridge_name='br-int',has_traffic_filtering=True,id=7966bbc1-c5cf-4215-a0f0-39382b12dda7,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7966bbc1-c5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.objects.instance [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:03:39 user nova-compute[75305]:   <uuid>2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2</uuid>
Nov 14 08:03:39 user nova-compute[75305]:   <name>instance-0000000a</name>
Nov 14 08:03:39 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:03:39 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:03:39 user nova-compute[75305]:   <metadata>
Nov 14 08:03:39 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:03:39 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:03:39 user nova-compute[75305]:       <nova:name>tempest-device-tagging-server-2035969857</nova:name>
Nov 14 08:03:39 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:03:31</nova:creationTime>
Nov 14 08:03:39 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:03:39 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:03:39 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:03:39 user nova-compute[75305]:       <nova:owner>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:user uuid="fed94e69e6b44903998b824566f85db2">tempest-TaggedBootDevicesTest-1271835931-project-member</nova:user>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:project uuid="75bf7951de484ad6b5296e643847583a">tempest-TaggedBootDevicesTest-1271835931</nova:project>
Nov 14 08:03:39 user nova-compute[75305]:       </nova:owner>
Nov 14 08:03:39 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:03:39 user nova-compute[75305]:       <nova:ports>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:port uuid="07ecf560-7926-48d7-a419-91293c5a8660">
Nov 14 08:03:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:03:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:port uuid="848a7a02-afae-41f9-a7d6-59cd81ffb56f">
Nov 14 08:03:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.71" ipVersion="4"/>
Nov 14 08:03:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:port uuid="b9b49c6d-8100-47af-8133-736ba3e1bde2">
Nov 14 08:03:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.210" ipVersion="4"/>
Nov 14 08:03:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:port uuid="5f93709c-024d-4406-bf37-8db387c5a6e8">
Nov 14 08:03:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.96" ipVersion="4"/>
Nov 14 08:03:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:port uuid="a4a1142a-6df6-43cb-ab40-73583596e249">
Nov 14 08:03:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Nov 14 08:03:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:port uuid="67ab3e90-3507-4776-883c-8bb583491e1c">
Nov 14 08:03:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 08:03:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:39 user nova-compute[75305]:         <nova:port uuid="7966bbc1-c5cf-4215-a0f0-39382b12dda7">
Nov 14 08:03:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 08:03:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:03:39 user nova-compute[75305]:       </nova:ports>
Nov 14 08:03:39 user nova-compute[75305]:     </nova:instance>
Nov 14 08:03:39 user nova-compute[75305]:   </metadata>
Nov 14 08:03:39 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:03:39 user nova-compute[75305]:     <system>
Nov 14 08:03:39 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:03:39 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:03:39 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:03:39 user nova-compute[75305]:       <entry name="serial">2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2</entry>
Nov 14 08:03:39 user nova-compute[75305]:       <entry name="uuid">2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2</entry>
Nov 14 08:03:39 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:03:39 user nova-compute[75305]:     </system>
Nov 14 08:03:39 user nova-compute[75305]:   </sysinfo>
Nov 14 08:03:39 user nova-compute[75305]:   <os>
Nov 14 08:03:39 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:03:39 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:03:39 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:03:39 user nova-compute[75305]:   </os>
Nov 14 08:03:39 user nova-compute[75305]:   <features>
Nov 14 08:03:39 user nova-compute[75305]:     <acpi/>
Nov 14 08:03:39 user nova-compute[75305]:     <apic/>
Nov 14 08:03:39 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:03:39 user nova-compute[75305]:   </features>
Nov 14 08:03:39 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:03:39 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:03:39 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:03:39 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:03:39 user nova-compute[75305]:   </clock>
Nov 14 08:03:39 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:03:39 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:03:39 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:03:39 user nova-compute[75305]:   </cpu>
Nov 14 08:03:39 user nova-compute[75305]:   <devices>
Nov 14 08:03:39 user nova-compute[75305]:     <disk type="file" device="cdrom">
Nov 14 08:03:39 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 08:03:39 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2/disk.config"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="hda" bus="ide"/>
Nov 14 08:03:39 user nova-compute[75305]:     </disk>
Nov 14 08:03:39 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:03:39 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:03:39 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <serial>48f60536-b768-4936-82dd-2e41231e6f50</serial>
Nov 14 08:03:39 user nova-compute[75305]:     </disk>
Nov 14 08:03:39 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:03:39 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:03:39 user nova-compute[75305]:       <source dev="/dev/sde"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <serial>d5677486-570c-4c75-b679-39a3d75036fe</serial>
Nov 14 08:03:39 user nova-compute[75305]:     </disk>
Nov 14 08:03:39 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:03:39 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:03:39 user nova-compute[75305]:       <source dev="/dev/sdg"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="vdc" bus="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <serial>1cd7f475-0e4e-4464-96be-db4080f6908e</serial>
Nov 14 08:03:39 user nova-compute[75305]:     </disk>
Nov 14 08:03:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:39 user nova-compute[75305]:       <mac address="fa:16:3e:92:2e:24"/>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="tap07ecf560-79"/>
Nov 14 08:03:39 user nova-compute[75305]:     </interface>
Nov 14 08:03:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:39 user nova-compute[75305]:       <mac address="fa:16:3e:94:0a:3d"/>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="tap848a7a02-af"/>
Nov 14 08:03:39 user nova-compute[75305]:     </interface>
Nov 14 08:03:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:39 user nova-compute[75305]:       <mac address="fa:16:3e:9b:d7:29"/>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="tapb9b49c6d-81"/>
Nov 14 08:03:39 user nova-compute[75305]:     </interface>
Nov 14 08:03:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:39 user nova-compute[75305]:       <mac address="fa:16:3e:df:95:ae"/>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="tap5f93709c-02"/>
Nov 14 08:03:39 user nova-compute[75305]:     </interface>
Nov 14 08:03:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:39 user nova-compute[75305]:       <mac address="fa:16:3e:8b:29:78"/>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="tapa4a1142a-6d"/>
Nov 14 08:03:39 user nova-compute[75305]:     </interface>
Nov 14 08:03:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:39 user nova-compute[75305]:       <mac address="fa:16:3e:22:bb:d2"/>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="tap67ab3e90-35"/>
Nov 14 08:03:39 user nova-compute[75305]:     </interface>
Nov 14 08:03:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:03:39 user nova-compute[75305]:       <mac address="fa:16:3e:ae:fa:93"/>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:03:39 user nova-compute[75305]:       <target dev="tap7966bbc1-c5"/>
Nov 14 08:03:39 user nova-compute[75305]:     </interface>
Nov 14 08:03:39 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:03:39 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2/console.log" append="off"/>
Nov 14 08:03:39 user nova-compute[75305]:     </serial>
Nov 14 08:03:39 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:03:39 user nova-compute[75305]:     <video>
Nov 14 08:03:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:03:39 user nova-compute[75305]:     </video>
Nov 14 08:03:39 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:03:39 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:03:39 user nova-compute[75305]:     </rng>
Nov 14 08:03:39 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:03:39 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:03:39 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:03:39 user nova-compute[75305]:     </memballoon>
Nov 14 08:03:39 user nova-compute[75305]:   </devices>
Nov 14 08:03:39 user nova-compute[75305]: </domain>
Nov 14 08:03:39 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:2e:24,bridge_name='br-int',has_traffic_filtering=True,id=07ecf560-7926-48d7-a419-91293c5a8660,network=Network(a773e639-a8dc-426b-97f6-b6325f50e56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ecf560-79') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2e:24,bridge_name='br-int',has_traffic_filtering=True,id=07ecf560-7926-48d7-a419-91293c5a8660,network=Network(a773e639-a8dc-426b-97f6-b6325f50e56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ecf560-79') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5723bd3e-df6f-57ca-a0ad-0c77774b4556', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap07ecf560-79, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap07ecf560-79, col_values=(('qos', UUID('0e5e59f5-9dd3-4761-b339-107a2f06d35f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap07ecf560-79, col_values=(('external_ids', {'iface-id': '07ecf560-7926-48d7-a419-91293c5a8660', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:2e:24', 'vm-uuid': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: INFO os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:2e:24,bridge_name='br-int',has_traffic_filtering=True,id=07ecf560-7926-48d7-a419-91293c5a8660,network=Network(a773e639-a8dc-426b-97f6-b6325f50e56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ecf560-79')
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:0a:3d,bridge_name='br-int',has_traffic_filtering=True,id=848a7a02-afae-41f9-a7d6-59cd81ffb56f,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap848a7a02-af') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:0a:3d,bridge_name='br-int',has_traffic_filtering=True,id=848a7a02-afae-41f9-a7d6-59cd81ffb56f,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap848a7a02-af') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ca83080-d262-5502-92de-828901fde7ae', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap848a7a02-af, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap848a7a02-af, col_values=(('qos', UUID('d18b80e5-7333-4302-b757-7e75b34ff3a5')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap848a7a02-af, col_values=(('external_ids', {'iface-id': '848a7a02-afae-41f9-a7d6-59cd81ffb56f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:0a:3d', 'vm-uuid': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: INFO os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:0a:3d,bridge_name='br-int',has_traffic_filtering=True,id=848a7a02-afae-41f9-a7d6-59cd81ffb56f,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap848a7a02-af')
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=b9b49c6d-8100-47af-8133-736ba3e1bde2,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9b49c6d-81') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=b9b49c6d-8100-47af-8133-736ba3e1bde2,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9b49c6d-81') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98955c7b-4598-5527-8533-60f4130209fc', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9b49c6d-81, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9b49c6d-81, col_values=(('qos', UUID('e1bae363-dbfe-4766-98c0-e7beae1bea07')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9b49c6d-81, col_values=(('external_ids', {'iface-id': 'b9b49c6d-8100-47af-8133-736ba3e1bde2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:d7:29', 'vm-uuid': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: INFO os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=b9b49c6d-8100-47af-8133-736ba3e1bde2,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9b49c6d-81')
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:95:ae,bridge_name='br-int',has_traffic_filtering=True,id=5f93709c-024d-4406-bf37-8db387c5a6e8,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f93709c-02') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:95:ae,bridge_name='br-int',has_traffic_filtering=True,id=5f93709c-024d-4406-bf37-8db387c5a6e8,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f93709c-02') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9fcc39e2-afe9-51f7-a65e-e05ffbb90de3', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f93709c-02, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f93709c-02, col_values=(('qos', UUID('d6e2af7e-7d87-479f-ab1e-02262f8ba1be')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f93709c-02, col_values=(('external_ids', {'iface-id': '5f93709c-024d-4406-bf37-8db387c5a6e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:95:ae', 'vm-uuid': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: INFO os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:95:ae,bridge_name='br-int',has_traffic_filtering=True,id=5f93709c-024d-4406-bf37-8db387c5a6e8,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f93709c-02')
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:29:78,bridge_name='br-int',has_traffic_filtering=True,id=a4a1142a-6df6-43cb-ab40-73583596e249,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a1142a-6d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:29:78,bridge_name='br-int',has_traffic_filtering=True,id=a4a1142a-6df6-43cb-ab40-73583596e249,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a1142a-6d') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edef6c30-d5cd-5369-b8a9-763d551e8e39', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4a1142a-6d, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4a1142a-6d, col_values=(('qos', UUID('01548529-32cb-459a-869e-10da26a54166')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4a1142a-6d, col_values=(('external_ids', {'iface-id': 'a4a1142a-6df6-43cb-ab40-73583596e249', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:29:78', 'vm-uuid': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: INFO os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:29:78,bridge_name='br-int',has_traffic_filtering=True,id=a4a1142a-6df6-43cb-ab40-73583596e249,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a1142a-6d')
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:bb:d2,bridge_name='br-int',has_traffic_filtering=True,id=67ab3e90-3507-4776-883c-8bb583491e1c,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab3e90-35') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:bb:d2,bridge_name='br-int',has_traffic_filtering=True,id=67ab3e90-3507-4776-883c-8bb583491e1c,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab3e90-35') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5954feca-9b64-5901-99f3-b1b0a69edc7a', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-ff5ff32a-6cdc-4c5a-ae8d-48e02fc7a010 req-3b3c23d0-9821-4ad3-8e65-f15b7894d94d service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff5ff32a-6cdc-4c5a-ae8d-48e02fc7a010 req-3b3c23d0-9821-4ad3-8e65-f15b7894d94d service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff5ff32a-6cdc-4c5a-ae8d-48e02fc7a010 req-3b3c23d0-9821-4ad3-8e65-f15b7894d94d service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff5ff32a-6cdc-4c5a-ae8d-48e02fc7a010 req-3b3c23d0-9821-4ad3-8e65-f15b7894d94d service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-ff5ff32a-6cdc-4c5a-ae8d-48e02fc7a010 req-3b3c23d0-9821-4ad3-8e65-f15b7894d94d service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:40 user nova-compute[75305]: WARNING nova.compute.manager [req-ff5ff32a-6cdc-4c5a-ae8d-48e02fc7a010 req-3b3c23d0-9821-4ad3-8e65-f15b7894d94d service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 for instance with vm_state building and task_state spawning.
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67ab3e90-35, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67ab3e90-35, col_values=(('qos', UUID('1a37d3ce-7f5a-43ca-9ac6-80927b992e6c')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67ab3e90-35, col_values=(('external_ids', {'iface-id': '67ab3e90-3507-4776-883c-8bb583491e1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:bb:d2', 'vm-uuid': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: INFO os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:bb:d2,bridge_name='br-int',has_traffic_filtering=True,id=67ab3e90-3507-4776-883c-8bb583491e1c,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab3e90-35')
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:03:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:fa:93,bridge_name='br-int',has_traffic_filtering=True,id=7966bbc1-c5cf-4215-a0f0-39382b12dda7,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7966bbc1-c5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:fa:93,bridge_name='br-int',has_traffic_filtering=True,id=7966bbc1-c5cf-4215-a0f0-39382b12dda7,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7966bbc1-c5') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fdf1e37a-8523-5459-a81e-5965ffe43ce1', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-61ea9e4f-b920-463c-9479-6506a4cb2030 req-1dfd0f27-ee8e-4420-ade9-d42f577a6930 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-61ea9e4f-b920-463c-9479-6506a4cb2030 req-1dfd0f27-ee8e-4420-ade9-d42f577a6930 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-61ea9e4f-b920-463c-9479-6506a4cb2030 req-1dfd0f27-ee8e-4420-ade9-d42f577a6930 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-61ea9e4f-b920-463c-9479-6506a4cb2030 req-1dfd0f27-ee8e-4420-ade9-d42f577a6930 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-61ea9e4f-b920-463c-9479-6506a4cb2030 req-1dfd0f27-ee8e-4420-ade9-d42f577a6930 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:41 user nova-compute[75305]: WARNING nova.compute.manager [req-61ea9e4f-b920-463c-9479-6506a4cb2030 req-1dfd0f27-ee8e-4420-ade9-d42f577a6930 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 for instance with vm_state building and task_state spawning.
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7966bbc1-c5, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7966bbc1-c5, col_values=(('qos', UUID('c09027fe-0614-45d6-857e-e2dcb50596a3')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7966bbc1-c5, col_values=(('external_ids', {'iface-id': '7966bbc1-c5cf-4215-a0f0-39382b12dda7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:fa:93', 'vm-uuid': '2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: INFO os_vif [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:fa:93,bridge_name='br-int',has_traffic_filtering=True,id=7966bbc1-c5cf-4215-a0f0-39382b12dda7,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7966bbc1-c5')
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] No BDM found with device name hda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] No VIF found with MAC fa:16:3e:92:2e:24, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] No VIF found with MAC fa:16:3e:8b:29:78, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:03:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Using config drive
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-79155e11-4643-410f-8deb-2ef6ba316884 req-d4783bbb-71a4-44b7-95c7-875572182ebe service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-79155e11-4643-410f-8deb-2ef6ba316884 req-d4783bbb-71a4-44b7-95c7-875572182ebe service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-79155e11-4643-410f-8deb-2ef6ba316884 req-d4783bbb-71a4-44b7-95c7-875572182ebe service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-79155e11-4643-410f-8deb-2ef6ba316884 req-d4783bbb-71a4-44b7-95c7-875572182ebe service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-79155e11-4643-410f-8deb-2ef6ba316884 req-d4783bbb-71a4-44b7-95c7-875572182ebe service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:41 user nova-compute[75305]: WARNING nova.compute.manager [req-79155e11-4643-410f-8deb-2ef6ba316884 req-d4783bbb-71a4-44b7-95c7-875572182ebe service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 for instance with vm_state building and task_state spawning.
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Creating config drive at /opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2/disk.config
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpecih0430 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpecih0430" returned: 0 in 0.058s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-859eb6f8-1eae-4cb2-b209-5f9c8a21b8a4 req-1267947a-774c-4150-a539-025b3fde2ef5 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-859eb6f8-1eae-4cb2-b209-5f9c8a21b8a4 req-1267947a-774c-4150-a539-025b3fde2ef5 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-859eb6f8-1eae-4cb2-b209-5f9c8a21b8a4 req-1267947a-774c-4150-a539-025b3fde2ef5 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-859eb6f8-1eae-4cb2-b209-5f9c8a21b8a4 req-1267947a-774c-4150-a539-025b3fde2ef5 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-859eb6f8-1eae-4cb2-b209-5f9c8a21b8a4 req-1267947a-774c-4150-a539-025b3fde2ef5 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:42 user nova-compute[75305]: WARNING nova.compute.manager [req-859eb6f8-1eae-4cb2-b209-5f9c8a21b8a4 req-1267947a-774c-4150-a539-025b3fde2ef5 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 for instance with vm_state building and task_state spawning.
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-a56e953c-be1e-4653-93e9-8f76f48716ae req-d38a567b-8032-4ea5-a590-b09de3c90acd service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:43 user nova-compute[75305]: WARNING nova.compute.manager [req-ba70ac10-09a9-4289-89c0-6f1cc5dc0615 req-a1632bd4-0ecf-46bf-9cda-8172ac60774a service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b for instance with vm_state building and task_state spawning.
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:44 user nova-compute[75305]: WARNING nova.compute.manager [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 for instance with vm_state building and task_state spawning.
Nov 14 08:03:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:44 user nova-compute[75305]: WARNING nova.compute.manager [req-cceb17dd-6a36-4ea9-901a-aeaee044e65d req-6e6f7ac9-7e68-44db-810b-332b74685764 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 for instance with vm_state building and task_state spawning.
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:45 user nova-compute[75305]: WARNING nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f for instance with vm_state building and task_state spawning.
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:45 user nova-compute[75305]: WARNING nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f for instance with vm_state building and task_state spawning.
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:45 user nova-compute[75305]: WARNING nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 for instance with vm_state building and task_state spawning.
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:45 user nova-compute[75305]: WARNING nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 for instance with vm_state building and task_state spawning.
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:45 user nova-compute[75305]: WARNING nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 for instance with vm_state building and task_state spawning.
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:45 user nova-compute[75305]: WARNING nova.compute.manager [req-2ac3fb58-56f0-42bc-a039-eff603f09807 req-5f088fdf-6ff2-452f-b385-0cdb7e7f36eb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 for instance with vm_state building and task_state spawning.
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:03:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance spawned successfully.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: INFO nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Took 15.18 seconds to spawn the instance on the hypervisor.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: INFO nova.compute.manager [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Took 34.28 seconds to build instance.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f0c1708d-fd3c-46b5-b4f3-abce8a4dcfb6 tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.381s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:46 user nova-compute[75305]: WARNING nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 for instance with vm_state building and task_state spawning.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:46 user nova-compute[75305]: WARNING nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 for instance with vm_state building and task_state spawning.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:46 user nova-compute[75305]: WARNING nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c for instance with vm_state building and task_state spawning.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:46 user nova-compute[75305]: WARNING nova.compute.manager [req-4d1c0fbf-3525-4bac-b8c8-da4f6e62da80 req-b6547049-b48d-49b5-bb31-f60890c9292d service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c for instance with vm_state building and task_state spawning.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-3f0c46bc-a9e2-404e-81b5-ee48adfa33d8 req-4a0b60cc-f92b-4c00-9a86-78d7fa59d25e service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3f0c46bc-a9e2-404e-81b5-ee48adfa33d8 req-4a0b60cc-f92b-4c00-9a86-78d7fa59d25e service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3f0c46bc-a9e2-404e-81b5-ee48adfa33d8 req-4a0b60cc-f92b-4c00-9a86-78d7fa59d25e service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3f0c46bc-a9e2-404e-81b5-ee48adfa33d8 req-4a0b60cc-f92b-4c00-9a86-78d7fa59d25e service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-3f0c46bc-a9e2-404e-81b5-ee48adfa33d8 req-4a0b60cc-f92b-4c00-9a86-78d7fa59d25e service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:46 user nova-compute[75305]: WARNING nova.compute.manager [req-3f0c46bc-a9e2-404e-81b5-ee48adfa33d8 req-4a0b60cc-f92b-4c00-9a86-78d7fa59d25e service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 for instance with vm_state building and task_state spawning.
Nov 14 08:03:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:03:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance spawned successfully.
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:03:48 user nova-compute[75305]: INFO nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Took 16.82 seconds to spawn the instance on the hypervisor.
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-a2a93bcc-9fd3-45aa-93c1-d3b60b325379 req-25858771-634a-49f2-80e0-bad0a431edd2 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a2a93bcc-9fd3-45aa-93c1-d3b60b325379 req-25858771-634a-49f2-80e0-bad0a431edd2 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a2a93bcc-9fd3-45aa-93c1-d3b60b325379 req-25858771-634a-49f2-80e0-bad0a431edd2 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a2a93bcc-9fd3-45aa-93c1-d3b60b325379 req-25858771-634a-49f2-80e0-bad0a431edd2 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-a2a93bcc-9fd3-45aa-93c1-d3b60b325379 req-25858771-634a-49f2-80e0-bad0a431edd2 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:03:48 user nova-compute[75305]: WARNING nova.compute.manager [req-a2a93bcc-9fd3-45aa-93c1-d3b60b325379 req-25858771-634a-49f2-80e0-bad0a431edd2 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 for instance with vm_state active and task_state None.
Nov 14 08:03:48 user nova-compute[75305]: INFO nova.compute.manager [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Took 35.40 seconds to build instance.
Nov 14 08:03:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-376c6445-7b6f-42fa-96d5-e6d25af8b29a tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.578s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:03:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:03:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "49ae6a17-49eb-4334-b517-1280009ae794" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "49ae6a17-49eb-4334-b517-1280009ae794" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:04:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:07 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:04:07 user nova-compute[75305]: INFO nova.compute.claims [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Claim successful on node user
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-changed-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Refreshing instance network info cache due to event network-changed-a89876c5-db54-4173-ae04-a88c966b86b5. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] Acquiring lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] Acquired lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.network.neutron [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Refreshing network info cache for port a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.network.neutron [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:04:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.policy [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6126101718a429183c2553d9b552360', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '527bf1ca93e8450293e5228c6ee1931f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:04:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Creating image(s)
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "/opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "/opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "/opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.484s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Successfully created port: 21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-changed-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Refreshing instance network info cache due to event network-changed-488cb4fa-c020-4834-a6e0-62c7f76dd23d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] Acquiring lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] Acquired lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.network.neutron [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Refreshing network info cache for port 488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.215s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk 1073741824" returned: 0 in 0.062s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.199s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.network.neutron [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updated VIF entry in instance network info cache for port a89876c5-db54-4173-ae04-a88c966b86b5. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.network.neutron [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ab1db06b-3a3e-4e65-a55b-e89002b452f9 req-70481159-093b-4bee-952c-f6b0ffba853e service nova] Releasing lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Cannot resize image /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Ensure instance console log exists: /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.network.neutron [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updated VIF entry in instance network info cache for port 488cb4fa-c020-4834-a6e0-62c7f76dd23d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG nova.network.neutron [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updating instance_info_cache with network_info: [{"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc545da4-0c30-4cde-bf9e-4c40bf16e5b7 req-a8c943e0-d1b0-4936-925d-6d8646db23c6 service nova] Releasing lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Successfully updated port: 21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "refresh_cache-49ae6a17-49eb-4334-b517-1280009ae794" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquired lock "refresh_cache-49ae6a17-49eb-4334-b517-1280009ae794" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received event network-changed-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Refreshing instance network info cache due to event network-changed-21ce6c08-9e5b-4cae-88eb-948fdda16ab2. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] Acquiring lock "refresh_cache-49ae6a17-49eb-4334-b517-1280009ae794" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Updating instance_info_cache with network_info: [{"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-changed-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing instance network info cache due to event network-changed-11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Releasing lock "refresh_cache-49ae6a17-49eb-4334-b517-1280009ae794" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Instance network_info: |[{"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] Acquired lock "refresh_cache-49ae6a17-49eb-4334-b517-1280009ae794" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Refreshing network info cache for port 21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Start _get_guest_xml network_info=[{"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:04:10 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:04:10 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2027456936',display_name='tempest-ServersNegativeTestJSON-server-2027456936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2027456936',id=13,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='527bf1ca93e8450293e5228c6ee1931f',ramdisk_id='',reservation_id='r-fbcfznkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281828421',owner_user_name='tempest-ServersNegativeTestJSON-281828421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:04:09Z,user_data=None,user_id='b6126101718a429183c2553d9b552360',uuid=49ae6a17-49eb-4334-b517-1280009ae794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converting VIF {"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:5b,bridge_name='br-int',has_traffic_filtering=True,id=21ce6c08-9e5b-4cae-88eb-948fdda16ab2,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce6c08-9e') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.objects.instance [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lazy-loading 'pci_devices' on Instance uuid 49ae6a17-49eb-4334-b517-1280009ae794 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:04:10 user nova-compute[75305]:   <uuid>49ae6a17-49eb-4334-b517-1280009ae794</uuid>
Nov 14 08:04:10 user nova-compute[75305]:   <name>instance-0000000d</name>
Nov 14 08:04:10 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:04:10 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:04:10 user nova-compute[75305]:   <metadata>
Nov 14 08:04:10 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:04:10 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:04:10 user nova-compute[75305]:       <nova:name>tempest-ServersNegativeTestJSON-server-2027456936</nova:name>
Nov 14 08:04:10 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:04:10</nova:creationTime>
Nov 14 08:04:10 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:04:10 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:04:10 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:04:10 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:04:10 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:04:10 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:04:10 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:04:10 user nova-compute[75305]:       <nova:owner>
Nov 14 08:04:10 user nova-compute[75305]:         <nova:user uuid="b6126101718a429183c2553d9b552360">tempest-ServersNegativeTestJSON-281828421-project-member</nova:user>
Nov 14 08:04:10 user nova-compute[75305]:         <nova:project uuid="527bf1ca93e8450293e5228c6ee1931f">tempest-ServersNegativeTestJSON-281828421</nova:project>
Nov 14 08:04:10 user nova-compute[75305]:       </nova:owner>
Nov 14 08:04:10 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:04:10 user nova-compute[75305]:       <nova:ports>
Nov 14 08:04:10 user nova-compute[75305]:         <nova:port uuid="21ce6c08-9e5b-4cae-88eb-948fdda16ab2">
Nov 14 08:04:10 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 08:04:10 user nova-compute[75305]:         </nova:port>
Nov 14 08:04:10 user nova-compute[75305]:       </nova:ports>
Nov 14 08:04:10 user nova-compute[75305]:     </nova:instance>
Nov 14 08:04:10 user nova-compute[75305]:   </metadata>
Nov 14 08:04:10 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:04:10 user nova-compute[75305]:     <system>
Nov 14 08:04:10 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:04:10 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:04:10 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:04:10 user nova-compute[75305]:       <entry name="serial">49ae6a17-49eb-4334-b517-1280009ae794</entry>
Nov 14 08:04:10 user nova-compute[75305]:       <entry name="uuid">49ae6a17-49eb-4334-b517-1280009ae794</entry>
Nov 14 08:04:10 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:04:10 user nova-compute[75305]:     </system>
Nov 14 08:04:10 user nova-compute[75305]:   </sysinfo>
Nov 14 08:04:10 user nova-compute[75305]:   <os>
Nov 14 08:04:10 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:04:10 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:04:10 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:04:10 user nova-compute[75305]:   </os>
Nov 14 08:04:10 user nova-compute[75305]:   <features>
Nov 14 08:04:10 user nova-compute[75305]:     <acpi/>
Nov 14 08:04:10 user nova-compute[75305]:     <apic/>
Nov 14 08:04:10 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:04:10 user nova-compute[75305]:   </features>
Nov 14 08:04:10 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:04:10 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:04:10 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:04:10 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:04:10 user nova-compute[75305]:   </clock>
Nov 14 08:04:10 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:04:10 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:04:10 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:04:10 user nova-compute[75305]:   </cpu>
Nov 14 08:04:10 user nova-compute[75305]:   <devices>
Nov 14 08:04:10 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:04:10 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:04:10 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk"/>
Nov 14 08:04:10 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:04:10 user nova-compute[75305]:     </disk>
Nov 14 08:04:10 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:04:10 user nova-compute[75305]:       <mac address="fa:16:3e:18:69:5b"/>
Nov 14 08:04:10 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:04:10 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:04:10 user nova-compute[75305]:       <target dev="tap21ce6c08-9e"/>
Nov 14 08:04:10 user nova-compute[75305]:     </interface>
Nov 14 08:04:10 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:04:10 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/console.log" append="off"/>
Nov 14 08:04:10 user nova-compute[75305]:     </serial>
Nov 14 08:04:10 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:04:10 user nova-compute[75305]:     <video>
Nov 14 08:04:10 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:04:10 user nova-compute[75305]:     </video>
Nov 14 08:04:10 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:04:10 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:04:10 user nova-compute[75305]:     </rng>
Nov 14 08:04:10 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:04:10 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:04:10 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:04:10 user nova-compute[75305]:     </memballoon>
Nov 14 08:04:10 user nova-compute[75305]:   </devices>
Nov 14 08:04:10 user nova-compute[75305]: </domain>
Nov 14 08:04:10 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2027456936',display_name='tempest-ServersNegativeTestJSON-server-2027456936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2027456936',id=13,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='527bf1ca93e8450293e5228c6ee1931f',ramdisk_id='',reservation_id='r-fbcfznkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-281828421',owner_user_name='tempest-ServersNegativeTestJSON-281828421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:04:09Z,user_data=None,user_id='b6126101718a429183c2553d9b552360',uuid=49ae6a17-49eb-4334-b517-1280009ae794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converting VIF {"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:5b,bridge_name='br-int',has_traffic_filtering=True,id=21ce6c08-9e5b-4cae-88eb-948fdda16ab2,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce6c08-9e') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG os_vif [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:5b,bridge_name='br-int',has_traffic_filtering=True,id=21ce6c08-9e5b-4cae-88eb-948fdda16ab2,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce6c08-9e') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '641e43d9-bede-52e8-a75c-3669e658cdab', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21ce6c08-9e, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21ce6c08-9e, col_values=(('qos', UUID('806fb8ac-bd82-4911-88c0-0de9b8de69f5')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21ce6c08-9e, col_values=(('external_ids', {'iface-id': '21ce6c08-9e5b-4cae-88eb-948fdda16ab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:69:5b', 'vm-uuid': '49ae6a17-49eb-4334-b517-1280009ae794'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:10 user nova-compute[75305]: INFO os_vif [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:5b,bridge_name='br-int',has_traffic_filtering=True,id=21ce6c08-9e5b-4cae-88eb-948fdda16ab2,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce6c08-9e')
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] No VIF found with MAC fa:16:3e:18:69:5b, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updated VIF entry in instance network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2944645-614c-45aa-add4-0394c172f50c req-730c9790-7f77-4b75-a9e6-108d710bc4df service nova] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-changed-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Refreshing instance network info cache due to event network-changed-9f99886b-aaf5-4e84-a5d2-2e74015f4386. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Refreshing network info cache for port 9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Updated VIF entry in instance network info cache for port 21ce6c08-9e5b-4cae-88eb-948fdda16ab2. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Updating instance_info_cache with network_info: [{"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a9608298-a5f8-4295-bd7f-bf6626f9f384 req-5132c3e4-242a-4b2f-925b-71127bc34ee5 service nova] Releasing lock "refresh_cache-49ae6a17-49eb-4334-b517-1280009ae794" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:04:11 user nova-compute[75305]: INFO nova.compute.manager [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] instance snapshotting
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Beginning live snapshot process
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updated VIF entry in instance network info cache for port 9f99886b-aaf5-4e84-a5d2-2e74015f4386. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e130e11d-3580-4376-b19b-034d058ce31d req-0bfa1dc8-55c4-417c-9bb8-ba2307f6cab1 service nova] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid 6dd11b5a-6147-4cd1-965a-19f75a091198 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0bcx7sr1/8165e1052e434239a89978af67682dbd.delta 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:12 user nova-compute[75305]: INFO nova.compute.manager [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Attaching volume 78216012-bbe0-49ba-942f-885dd281d83b to /dev/vdb
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0bcx7sr1/8165e1052e434239a89978af67682dbd.delta 1073741824" returned: 0 in 0.085s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 08:04:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75305) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 08:04:12 user nova-compute[75305]: INFO nova.virt.libvirt.host [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] UEFI support detected
Nov 14 08:04:12 user nova-compute[75305]: DEBUG os_brick.utils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89158950-2e64-4836-afb4-768baa79a59d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5e032e-e463-4a79-ae1d-d4911eea8651]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb248787-8edd-46ef-a4f8-c8230b2a6e89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f9b5f2-40f5-4013-b6c8-700eca3d879d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:12 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdee5639-316b-4145-a13f-ac92c4f3c717]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG os_brick.utils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updating existing volume attachment record: 247dc5fd-c0a0-4445-b99f-cb44fb471ddf {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received event network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] Acquiring lock "49ae6a17-49eb-4334-b517-1280009ae794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] No waiting events found dispatching network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:04:13 user nova-compute[75305]: WARNING nova.compute.manager [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received unexpected event network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 for instance with vm_state building and task_state spawning.
Nov 14 08:04:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received event network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] Acquiring lock "49ae6a17-49eb-4334-b517-1280009ae794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] No waiting events found dispatching network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:04:13 user nova-compute[75305]: WARNING nova.compute.manager [req-516548c3-4383-45e1-97fc-58d50010425a req-55784d7d-9d59-421b-9749-da60acc9a359 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received unexpected event network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 for instance with vm_state building and task_state spawning.
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:04:13 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0bcx7sr1/8165e1052e434239a89978af67682dbd.delta /opt/stack/data/nova/instances/snapshots/tmp0bcx7sr1/8165e1052e434239a89978af67682dbd {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0bcx7sr1/8165e1052e434239a89978af67682dbd.delta /opt/stack/data/nova/instances/snapshots/tmp0bcx7sr1/8165e1052e434239a89978af67682dbd" returned: 0 in 1.763s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:04:15 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Snapshot extracted, beginning image upload
Nov 14 08:04:15 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Instance spawned successfully.
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:04:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:04:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=6589MB free_disk=25.410873413085938GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:15 user nova-compute[75305]: INFO nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Took 7.34 seconds to spawn the instance on the hypervisor.
Nov 14 08:04:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:04:16 user nova-compute[75305]: INFO nova.compute.manager [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Took 8.21 seconds to build instance.
Nov 14 08:04:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-daa23cb9-362b-4ddf-bb7a-4b094021601b tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "49ae6a17-49eb-4334-b517-1280009ae794" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.314s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6dd11b5a-6147-4cd1-965a-19f75a091198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5959dc8-a417-4528-9f03-3951186c2315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 32a98fdb-39f7-496a-95f9-6bcd1606a2fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 49ae6a17-49eb-4334-b517-1280009ae794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:04:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.729s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnfrwSPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:17 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:17 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:17 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85990714-69e9-476b-9e5a-071cd4fda57c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:04:17 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aafdd80-32c3-4ce0-8db1-2b4f3cdfc2be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b] added
Nov 14 08:04:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da8bbca-ddc2-4e48-b47a-6097aea4a363]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c528b1a8-acf5-44b6-9206-3cfcdd6dc2af]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnfrwSPv {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cnfrwSPv" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb4fdbf-09f6-4b91-be12-5d8a10672993]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cnfrwSPv'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21907094-ee86-464d-a5b4-8b04773e2492]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f1b59-4415-449b-b6fe-7904ba087ee7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --login" returned: 0 in 0.186s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49f4d98-1212-4664-83c0-7953dc12215c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260]
Nov 14 08:04:17 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260] successful.
Nov 14 08:04:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1126e393-38ff-448f-b860-44f5542eb1c7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc21b7fc-af1a-4052-a19d-83fa5101da26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:17 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3430bf32-2178-4801-8a83-9840bff94aa7]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updating instance_info_cache with network_info: [{"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:04:18 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Snapshot image upload complete
Nov 14 08:04:18 user nova-compute[75305]: INFO nova.compute.manager [None req-5cd5f8d5-2c27-4f9c-8156-2d899a5c171d tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Took 7.21 seconds to snapshot the instance on the hypervisor.
Nov 14 08:04:18 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnfrwSPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.483s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== connect_volume: return (1484ms) {'type': 'block', 'scsi_wwn': '23461373164326136', 'path': '/dev/sdh'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461373164326136', 'path': '/dev/sdh'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid 6dd11b5a-6147-4cd1-965a-19f75a091198 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:04:18 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:18 user nova-compute[75305]:   <source dev="/dev/sdh"/>
Nov 14 08:04:18 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:04:18 user nova-compute[75305]:   <serial>78216012-bbe0-49ba-942f-885dd281d83b</serial>
Nov 14 08:04:18 user nova-compute[75305]: </disk>
Nov 14 08:04:18 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:04:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No VIF found with MAC fa:16:3e:86:a0:f3, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:04:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ba8f5e1-926a-46a3-aa14-4a68ae33c214 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.007s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:22 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:04:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:22 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:04:22 user nova-compute[75305]: INFO nova.compute.claims [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Claim successful on node user
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.653s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:04:23 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.policy [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6921b8792c4b4f098ee61c6d8bc840c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeba260be7f045959c391eb65633be89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:04:23 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Creating image(s)
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.217s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.234s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk 1073741824" returned: 0 in 0.055s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Successfully created port: f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Cannot resize image /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Ensure instance console log exists: /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Successfully updated port: f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquired lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-changed-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Refreshing instance network info cache due to event network-changed-f1b43dba-2876-48a4-8e38-59cc2428f26d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] Acquiring lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Updating instance_info_cache with network_info: [{"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Releasing lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Instance network_info: |[{"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] Acquired lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Refreshing network info cache for port f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Start _get_guest_xml network_info=[{"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:04:24 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:04:24 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1022655961',display_name='tempest-AttachVolumeNegativeTest-server-1022655961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1022655961',id=14,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHjVedx8H+Jzjn6MJWzm3wmkqQnk7EWcncuayyG511jDCQX5BZ54ccAtfLdPQHV0D35qFXK9Lyc6BrTVc+22+f9EiKFNImovK7NwceVtMH1E16bbf6XHl48dyukuF6VYw==',key_name='tempest-keypair-266849130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-4wy89g2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a8:f5,bridge_name='br-int',has_traffic_filtering=True,id=f1b43dba-2876-48a4-8e38-59cc2428f26d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b43dba-28') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:04:24 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'pci_devices' on Instance uuid d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:04:25 user nova-compute[75305]:   <uuid>d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea</uuid>
Nov 14 08:04:25 user nova-compute[75305]:   <name>instance-0000000e</name>
Nov 14 08:04:25 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:04:25 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:04:25 user nova-compute[75305]:   <metadata>
Nov 14 08:04:25 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:04:25 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:04:25 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1022655961</nova:name>
Nov 14 08:04:25 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:04:24</nova:creationTime>
Nov 14 08:04:25 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:04:25 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:04:25 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:04:25 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:04:25 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:04:25 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:04:25 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:04:25 user nova-compute[75305]:       <nova:owner>
Nov 14 08:04:25 user nova-compute[75305]:         <nova:user uuid="6921b8792c4b4f098ee61c6d8bc840c9">tempest-AttachVolumeNegativeTest-1514251643-project-member</nova:user>
Nov 14 08:04:25 user nova-compute[75305]:         <nova:project uuid="aeba260be7f045959c391eb65633be89">tempest-AttachVolumeNegativeTest-1514251643</nova:project>
Nov 14 08:04:25 user nova-compute[75305]:       </nova:owner>
Nov 14 08:04:25 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:04:25 user nova-compute[75305]:       <nova:ports>
Nov 14 08:04:25 user nova-compute[75305]:         <nova:port uuid="f1b43dba-2876-48a4-8e38-59cc2428f26d">
Nov 14 08:04:25 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:04:25 user nova-compute[75305]:         </nova:port>
Nov 14 08:04:25 user nova-compute[75305]:       </nova:ports>
Nov 14 08:04:25 user nova-compute[75305]:     </nova:instance>
Nov 14 08:04:25 user nova-compute[75305]:   </metadata>
Nov 14 08:04:25 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:04:25 user nova-compute[75305]:     <system>
Nov 14 08:04:25 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:04:25 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:04:25 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:04:25 user nova-compute[75305]:       <entry name="serial">d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea</entry>
Nov 14 08:04:25 user nova-compute[75305]:       <entry name="uuid">d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea</entry>
Nov 14 08:04:25 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:04:25 user nova-compute[75305]:     </system>
Nov 14 08:04:25 user nova-compute[75305]:   </sysinfo>
Nov 14 08:04:25 user nova-compute[75305]:   <os>
Nov 14 08:04:25 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:04:25 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:04:25 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:04:25 user nova-compute[75305]:   </os>
Nov 14 08:04:25 user nova-compute[75305]:   <features>
Nov 14 08:04:25 user nova-compute[75305]:     <acpi/>
Nov 14 08:04:25 user nova-compute[75305]:     <apic/>
Nov 14 08:04:25 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:04:25 user nova-compute[75305]:   </features>
Nov 14 08:04:25 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:04:25 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:04:25 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:04:25 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:04:25 user nova-compute[75305]:   </clock>
Nov 14 08:04:25 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:04:25 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:04:25 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:04:25 user nova-compute[75305]:   </cpu>
Nov 14 08:04:25 user nova-compute[75305]:   <devices>
Nov 14 08:04:25 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:04:25 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:04:25 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk"/>
Nov 14 08:04:25 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:04:25 user nova-compute[75305]:     </disk>
Nov 14 08:04:25 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:04:25 user nova-compute[75305]:       <mac address="fa:16:3e:e7:a8:f5"/>
Nov 14 08:04:25 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:04:25 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:04:25 user nova-compute[75305]:       <target dev="tapf1b43dba-28"/>
Nov 14 08:04:25 user nova-compute[75305]:     </interface>
Nov 14 08:04:25 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:04:25 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/console.log" append="off"/>
Nov 14 08:04:25 user nova-compute[75305]:     </serial>
Nov 14 08:04:25 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:04:25 user nova-compute[75305]:     <video>
Nov 14 08:04:25 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:04:25 user nova-compute[75305]:     </video>
Nov 14 08:04:25 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:04:25 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:04:25 user nova-compute[75305]:     </rng>
Nov 14 08:04:25 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:04:25 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:04:25 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:04:25 user nova-compute[75305]:     </memballoon>
Nov 14 08:04:25 user nova-compute[75305]:   </devices>
Nov 14 08:04:25 user nova-compute[75305]: </domain>
Nov 14 08:04:25 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1022655961',display_name='tempest-AttachVolumeNegativeTest-server-1022655961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1022655961',id=14,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHjVedx8H+Jzjn6MJWzm3wmkqQnk7EWcncuayyG511jDCQX5BZ54ccAtfLdPQHV0D35qFXK9Lyc6BrTVc+22+f9EiKFNImovK7NwceVtMH1E16bbf6XHl48dyukuF6VYw==',key_name='tempest-keypair-266849130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-4wy89g2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:04:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a8:f5,bridge_name='br-int',has_traffic_filtering=True,id=f1b43dba-2876-48a4-8e38-59cc2428f26d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b43dba-28') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG os_vif [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a8:f5,bridge_name='br-int',has_traffic_filtering=True,id=f1b43dba-2876-48a4-8e38-59cc2428f26d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b43dba-28') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9a7a320c-0d36-5b7b-8e31-c6e3e3c3d5db', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1b43dba-28, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1b43dba-28, col_values=(('qos', UUID('79a73c98-b19e-411a-8e6c-48abdaf0c1c7')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1b43dba-28, col_values=(('external_ids', {'iface-id': 'f1b43dba-2876-48a4-8e38-59cc2428f26d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:a8:f5', 'vm-uuid': 'd6474ac0-fcb9-4244-a2c2-d08c35bdd8ea'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:25 user nova-compute[75305]: INFO os_vif [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a8:f5,bridge_name='br-int',has_traffic_filtering=True,id=f1b43dba-2876-48a4-8e38-59cc2428f26d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b43dba-28')
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No VIF found with MAC fa:16:3e:e7:a8:f5, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Updated VIF entry in instance network info cache for port f1b43dba-2876-48a4-8e38-59cc2428f26d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Updating instance_info_cache with network_info: [{"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-58141417-a133-4eb9-b863-4f688a98b32b req-e46384ef-a9e4-4b56-9c2b-50764dbe49d1 service nova] Releasing lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-b44950b6-4d78-4e93-b9ef-505fedafe5e0 req-21933490-b43e-4480-bfb9-2e2c36090e6e service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b44950b6-4d78-4e93-b9ef-505fedafe5e0 req-21933490-b43e-4480-bfb9-2e2c36090e6e service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b44950b6-4d78-4e93-b9ef-505fedafe5e0 req-21933490-b43e-4480-bfb9-2e2c36090e6e service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b44950b6-4d78-4e93-b9ef-505fedafe5e0 req-21933490-b43e-4480-bfb9-2e2c36090e6e service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-b44950b6-4d78-4e93-b9ef-505fedafe5e0 req-21933490-b43e-4480-bfb9-2e2c36090e6e service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:04:26 user nova-compute[75305]: WARNING nova.compute.manager [req-b44950b6-4d78-4e93-b9ef-505fedafe5e0 req-21933490-b43e-4480-bfb9-2e2c36090e6e service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received unexpected event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with vm_state building and task_state spawning.
Nov 14 08:04:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-changed-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Refreshing instance network info cache due to event network-changed-f47f5f90-3725-47e3-a576-90bce6f62f7f. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] Acquiring lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] Acquired lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Refreshing network info cache for port f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Updated VIF entry in instance network info cache for port f47f5f90-3725-47e3-a576-90bce6f62f7f. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Updating instance_info_cache with network_info: [{"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fe7c6aef-6f86-4481-b45d-dea9e1e6d011 req-2ad5ccb9-0b65-4289-9d15-52b41cc00f3e service nova] Releasing lock "refresh_cache-9cc7b521-becf-40dc-bbef-fd6523e59b50" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:04:28 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Instance spawned successfully.
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-88de007e-ac1e-453a-8d66-6a272bf6f1b0 req-3c74781b-a376-4e35-b729-f35e98cb5e44 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-88de007e-ac1e-453a-8d66-6a272bf6f1b0 req-3c74781b-a376-4e35-b729-f35e98cb5e44 service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-88de007e-ac1e-453a-8d66-6a272bf6f1b0 req-3c74781b-a376-4e35-b729-f35e98cb5e44 service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-88de007e-ac1e-453a-8d66-6a272bf6f1b0 req-3c74781b-a376-4e35-b729-f35e98cb5e44 service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-88de007e-ac1e-453a-8d66-6a272bf6f1b0 req-3c74781b-a376-4e35-b729-f35e98cb5e44 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:04:28 user nova-compute[75305]: WARNING nova.compute.manager [req-88de007e-ac1e-453a-8d66-6a272bf6f1b0 req-3c74781b-a376-4e35-b729-f35e98cb5e44 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received unexpected event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with vm_state building and task_state spawning.
Nov 14 08:04:28 user nova-compute[75305]: INFO nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 14 08:04:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:04:29 user nova-compute[75305]: INFO nova.compute.manager [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Took 6.41 seconds to build instance.
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b8ee066-3865-46a6-9155-3a4064ece8d1 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.524s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lazy-loading 'flavor' on Instance uuid 9cc7b521-becf-40dc-bbef-fd6523e59b50 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:29 user nova-compute[75305]: INFO nova.compute.manager [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Attaching volume 1be822b1-c599-49ec-9a09-5b79831a90f8 to /dev/sdc
Nov 14 08:04:29 user nova-compute[75305]: DEBUG os_brick.utils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f207a88-93f5-4e8a-bb90-d457134fd32d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0459d9-2e23-46b3-9196-9a688d76b10b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f39ab8-fc08-45ff-ac15-bcf89a29b35f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[575fa340-7068-4815-96a8-8bf7e830322f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:29 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:04:29 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f89738c-d529-4180-9a00-e82eac11fa4b]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG os_brick.utils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:29 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Updating existing volume attachment record: 2afa2755-bdbc-441b-b1d8-f9decc9f1309 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "interface-186a5286-ecc4-43e6-aea3-2529ddd72b58-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "interface-186a5286-ecc4-43e6-aea3-2529ddd72b58-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.objects.instance [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'flavor' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.objects.instance [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'pci_requests' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.objects.base [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Object Instance<186a5286-ecc4-43e6-aea3-2529ddd72b58> lazy-loaded attributes: flavor,pci_requests {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.policy [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c90e99f86334376bdbfd4b76263fd15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed60def7f2d441fcb3147dc96fdce086', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-changed-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Refreshing instance network info cache due to event network-changed-88edc6a5-9716-411e-8ea6-9da3cac488d0. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] Acquiring lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] Acquired lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:30 user nova-compute[75305]: DEBUG nova.network.neutron [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Refreshing network info cache for port 88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:31 user nova-compute[75305]: DEBUG nova.network.neutron [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Successfully created port: 252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:04:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updated VIF entry in instance network info cache for port 88edc6a5-9716-411e-8ea6-9da3cac488d0. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-eb193647-15a5-42da-85ff-487074b6020e req-5d4cc2e0-3ff3-4d38-b1e5-9729c31eece7 service nova] Releasing lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Successfully updated port: 252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquired lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.compute.manager [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-changed-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.compute.manager [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Refreshing instance network info cache due to event network-changed-252d2d44-8c0d-4941-b436-9894773fc7ab. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] Acquiring lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Releasing lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] Acquired lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.neutron [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Refreshing network info cache for port 252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converting VIF {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG os_vif [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd6612ee-cb76-5976-8288-fec9ee882362', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap252d2d44-8c, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap252d2d44-8c, col_values=(('qos', UUID('e0dbd513-6aeb-4cb1-904f-287890928657')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap252d2d44-8c, col_values=(('external_ids', {'iface-id': '252d2d44-8c0d-4941-b436-9894773fc7ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:13:0e', 'vm-uuid': '186a5286-ecc4-43e6-aea3-2529ddd72b58'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: INFO os_vif [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c')
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converting VIF {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] attach device xml: <interface type="ethernet">
Nov 14 08:04:32 user nova-compute[75305]:   <mac address="fa:16:3e:05:13:0e"/>
Nov 14 08:04:32 user nova-compute[75305]:   <model type="virtio"/>
Nov 14 08:04:32 user nova-compute[75305]:   <mtu size="1442"/>
Nov 14 08:04:32 user nova-compute[75305]:   <target dev="tap252d2d44-8c"/>
Nov 14 08:04:32 user nova-compute[75305]: </interface>
Nov 14 08:04:32 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-6d470bdf-1ee1-4955-a927-dca638b2f70f req-ec15ac4b-83e3-45ec-a634-4f2555277680 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6d470bdf-1ee1-4955-a927-dca638b2f70f req-ec15ac4b-83e3-45ec-a634-4f2555277680 service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6d470bdf-1ee1-4955-a927-dca638b2f70f req-ec15ac4b-83e3-45ec-a634-4f2555277680 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6d470bdf-1ee1-4955-a927-dca638b2f70f req-ec15ac4b-83e3-45ec-a634-4f2555277680 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-6d470bdf-1ee1-4955-a927-dca638b2f70f req-ec15ac4b-83e3-45ec-a634-4f2555277680 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:04:33 user nova-compute[75305]: WARNING nova.compute.manager [req-6d470bdf-1ee1-4955-a927-dca638b2f70f req-ec15ac4b-83e3-45ec-a634-4f2555277680 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received unexpected event network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab for instance with vm_state active and task_state None.
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No BDM found with device name hda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No VIF found with MAC fa:16:3e:74:b6:cb, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:04:33 user nova-compute[75305]:   <nova:package version="0.0.0"/>
Nov 14 08:04:33 user nova-compute[75305]:   <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:04:33 user nova-compute[75305]:   <nova:creationTime>2023-11-14 08:04:33</nova:creationTime>
Nov 14 08:04:33 user nova-compute[75305]:   <nova:flavor name="m1.tiny">
Nov 14 08:04:33 user nova-compute[75305]:     <nova:memory>512</nova:memory>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:disk>1</nova:disk>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:swap>0</nova:swap>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:vcpus>1</nova:vcpus>
Nov 14 08:04:33 user nova-compute[75305]:   </nova:flavor>
Nov 14 08:04:33 user nova-compute[75305]:   <nova:owner>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:04:33 user nova-compute[75305]:   </nova:owner>
Nov 14 08:04:33 user nova-compute[75305]:   <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:04:33 user nova-compute[75305]:   <nova:ports>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:04:33 user nova-compute[75305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:04:33 user nova-compute[75305]:     </nova:port>
Nov 14 08:04:33 user nova-compute[75305]:     <nova:port uuid="252d2d44-8c0d-4941-b436-9894773fc7ab">
Nov 14 08:04:33 user nova-compute[75305]:       <nova:ip type="fixed" address="10.10.10.168" ipVersion="4"/>
Nov 14 08:04:33 user nova-compute[75305]:     </nova:port>
Nov 14 08:04:33 user nova-compute[75305]:   </nova:ports>
Nov 14 08:04:33 user nova-compute[75305]: </nova:instance>
Nov 14 08:04:33 user nova-compute[75305]:  {{(pid=75305) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.network.neutron [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updated VIF entry in instance network info cache for port 252d2d44-8c0d-4941-b436-9894773fc7ab. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.network.neutron [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c4fe0a53-e94a-49d7-8553-7c32951a92de req-2b26ea04-1cd3-4ffb-8b5f-feb0d43aed45 service nova] Releasing lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19321541-1b63-4a27-9411-d352801e6235 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "interface-186a5286-ecc4-43e6-aea3-2529ddd72b58-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.772s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'flavor' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:33 user nova-compute[75305]: INFO nova.compute.manager [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Attaching volume 7d847c96-5548-434f-8f44-bf94eb10ee09 to /dev/vdb
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.utils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[006a3806-6d19-46f8-938a-960cb2fc90d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff244fb-1b07-45d3-a188-5a6f8f7f14e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8137748b-88ad-428c-803b-abcdac209782]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c1adcf-45d2-4932-b6d3-f8161f223998]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:34 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2508c3e5-36ec-4da8-a266-fcfaa7189de6]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.utils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating existing volume attachment record: e8644de5-c5cc-4585-be74-0aa814c891ce {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCzjhKSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:34 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:34 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:34 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c963ec52-0438-4f45-8af8-3a55e1a98d3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:04:34 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d9146-4cb7-4420-a497-9a915745c7b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8] added
Nov 14 08:04:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb2fb3d-aa36-4398-8fca-142a3097b167]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7566402-babb-4e69-8116-6a1a55b65275]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCzjhKSN {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LCzjhKSN" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b427e9d3-85e8-4c7d-bd06-3b5e14527c9d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LCzjhKSN'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52e8e2e-890b-4b8b-9e45-de48cc71f007]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e37480-70b3-4c82-bf5d-d9160cc27d26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07d5b8e-5839-49c9-9332-ae2ea93498f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260]
Nov 14 08:04:35 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260] successful.
Nov 14 08:04:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee084e4-5699-4a64-8324-a4072ed4ccf7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a356403e-e447-46db-97e5-8c74e9b0776a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:35 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0708d69f-6db9-4bd0-ae4e-954b5a6d46a8]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCzjhKSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d18ca25-a6c4-46ff-8675-f74ca783fc7f req-ddd453ce-d1bd-4851-9e81-8e01d8c123e4 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d18ca25-a6c4-46ff-8675-f74ca783fc7f req-ddd453ce-d1bd-4851-9e81-8e01d8c123e4 service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d18ca25-a6c4-46ff-8675-f74ca783fc7f req-ddd453ce-d1bd-4851-9e81-8e01d8c123e4 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d18ca25-a6c4-46ff-8675-f74ca783fc7f req-ddd453ce-d1bd-4851-9e81-8e01d8c123e4 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d18ca25-a6c4-46ff-8675-f74ca783fc7f req-ddd453ce-d1bd-4851-9e81-8e01d8c123e4 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:04:35 user nova-compute[75305]: WARNING nova.compute.manager [req-0d18ca25-a6c4-46ff-8675-f74ca783fc7f req-ddd453ce-d1bd-4851-9e81-8e01d8c123e4 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received unexpected event network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab for instance with vm_state active and task_state None.
Nov 14 08:04:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23163323136393962', 'path': '/dev/sdi'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163323136393962', 'path': '/dev/sdi'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lazy-loading 'flavor' on Instance uuid 9cc7b521-becf-40dc-bbef-fd6523e59b50 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:04:36 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:36 user nova-compute[75305]:   <source dev="/dev/sdi"/>
Nov 14 08:04:36 user nova-compute[75305]:   <target dev="sdc" bus="scsi"/>
Nov 14 08:04:36 user nova-compute[75305]:   <serial>1be822b1-c599-49ec-9a09-5b79831a90f8</serial>
Nov 14 08:04:36 user nova-compute[75305]:   <address type="drive" controller="0" unit="2"/>
Nov 14 08:04:36 user nova-compute[75305]: </disk>
Nov 14 08:04:36 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] No BDM found with device name sda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] No VIF found with MAC fa:16:3e:78:c1:39, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:04:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6b68b025-ca06-4b65-806a-033c3a398ea0 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.167s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:37 user nova-compute[75305]: INFO nova.compute.manager [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Detaching volume 1be822b1-c599-49ec-9a09-5b79831a90f8
Nov 14 08:04:37 user nova-compute[75305]: INFO nova.virt.block_device [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Attempting to driver detach volume 1be822b1-c599-49ec-9a09-5b79831a90f8 from mountpoint /dev/sdc
Nov 14 08:04:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Attempting to detach device sdc from instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:04:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:04:37 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:37 user nova-compute[75305]:   <source dev="/dev/sdi"/>
Nov 14 08:04:37 user nova-compute[75305]:   <target dev="sdc" bus="scsi"/>
Nov 14 08:04:37 user nova-compute[75305]:   <serial>1be822b1-c599-49ec-9a09-5b79831a90f8</serial>
Nov 14 08:04:37 user nova-compute[75305]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 08:04:37 user nova-compute[75305]: </disk>
Nov 14 08:04:37 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:04:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:37 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Successfully detached device sdc from instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 from the persistent domain config.
Nov 14 08:04:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:04:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:04:37 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:37 user nova-compute[75305]:   <source dev="/dev/sdi"/>
Nov 14 08:04:37 user nova-compute[75305]:   <target dev="sdc" bus="scsi"/>
Nov 14 08:04:37 user nova-compute[75305]:   <serial>1be822b1-c599-49ec-9a09-5b79831a90f8</serial>
Nov 14 08:04:37 user nova-compute[75305]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 08:04:37 user nova-compute[75305]: </disk>
Nov 14 08:04:37 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItinHuhS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:38 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:38 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:38 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e3195-00bc-4def-9b64-def437b44b22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:04:38 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f2da7-ff02-410c-b14a-81abba129b93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09] added
Nov 14 08:04:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f2ea0a-6d58-4f46-8031-960d644264a2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4862cf39-2930-4cea-9414-2d2147f22550]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItinHuhS {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItinHuhS" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f209b311-ab76-4d34-9055-ed2d5c294fb0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItinHuhS'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40624117-72f0-4b01-a954-58063a96b25a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3c9b3c-80d7-43e6-bbbc-910bf8745d5a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --login" returned: 0 in 0.121s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc9294-450d-41b9-9244-91b64b6fe0bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260]
Nov 14 08:04:38 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260] successful.
Nov 14 08:04:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6fe266-03c9-4711-af88-41c12a8e3e5b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d56fd-e01a-40cf-ac5d-4bcd641e070c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:38 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21b2eac-6088-4680-b0bf-a448f8e31dfb]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:04:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItinHuhS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:04:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23666363666333030', 'path': '/dev/sdj'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666363666333030', 'path': '/dev/sdj'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:04:40 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'flavor' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:04:40 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:40 user nova-compute[75305]:   <source dev="/dev/sdj"/>
Nov 14 08:04:40 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:04:40 user nova-compute[75305]:   <serial>7d847c96-5548-434f-8f44-bf94eb10ee09</serial>
Nov 14 08:04:40 user nova-compute[75305]: </disk>
Nov 14 08:04:40 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:04:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No BDM found with device name hda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] No VIF found with MAC fa:16:3e:74:b6:cb, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:04:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a1dbbc7-0d9f-42ec-98dc-72bfa523f1c2 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.638s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:42 user nova-compute[75305]: INFO nova.compute.manager [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Detaching volume 7d847c96-5548-434f-8f44-bf94eb10ee09
Nov 14 08:04:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:42 user nova-compute[75305]: INFO nova.virt.block_device [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Attempting to driver detach volume 7d847c96-5548-434f-8f44-bf94eb10ee09 from mountpoint /dev/vdb
Nov 14 08:04:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Attempting to detach device vdb from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:04:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:04:42 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:42 user nova-compute[75305]:   <source dev="/dev/sdj"/>
Nov 14 08:04:42 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:04:42 user nova-compute[75305]:   <serial>7d847c96-5548-434f-8f44-bf94eb10ee09</serial>
Nov 14 08:04:42 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 08:04:42 user nova-compute[75305]: </disk>
Nov 14 08:04:42 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:04:42 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully detached device vdb from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the persistent domain config.
Nov 14 08:04:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:04:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:04:42 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:42 user nova-compute[75305]:   <source dev="/dev/sdj"/>
Nov 14 08:04:42 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:04:42 user nova-compute[75305]:   <serial>7d847c96-5548-434f-8f44-bf94eb10ee09</serial>
Nov 14 08:04:42 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 08:04:42 user nova-compute[75305]: </disk>
Nov 14 08:04:42 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:04:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-changed-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Refreshing instance network info cache due to event network-changed-ef83a02a-32fc-4d4b-8801-55bccce74380. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] Acquiring lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] Acquired lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Refreshing network info cache for port ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG nova.objects.instance [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lazy-loading 'flavor' on Instance uuid 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Updated VIF entry in instance network info cache for port ef83a02a-32fc-4d4b-8801-55bccce74380. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Updating instance_info_cache with network_info: [{"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48d7b58e-bd15-40fa-8cae-996db011b16a req-96a5fb12-ec6b-47a1-963e-3b8ec3cdd8bd service nova] Releasing lock "refresh_cache-0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:43 user nova-compute[75305]: INFO nova.compute.manager [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Attaching volume 10bdb17b-c188-425a-8527-4e25dd037bc6 to /dev/vdb
Nov 14 08:04:43 user nova-compute[75305]: DEBUG os_brick.utils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dab7c5f-3f89-4fd5-a0a9-d3518bcd69c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[678165a6-b044-4634-9687-65490140096c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d1f4f5-e944-4b82-8f35-af8aa8f3b041]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f69fa8a-5fe6-4661-bab0-8aa8aa9d9350]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:04:43 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:04:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d75d4d-24bc-45c3-9426-8d1f20eb3fae]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG os_brick.utils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:43 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Updating existing volume attachment record: 36b3cb86-2ab4-4d43-876b-2cb1a630b54f {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:04:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNevTfOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:48 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:48 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:48 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e0d8ae-c279-4539-a15e-ad32fd071c8b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:04:48 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9539eb69-3f15-4173-aff2-aa5087909ff0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6] added
Nov 14 08:04:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7651dbf1-982a-4389-8c36-6b3e5f90e9e6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[969edd12-2048-4b75-b64a-a14ee5c74547]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNevTfOo {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DNevTfOo" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1ecf14-ce45-401c-954b-6f2e02896845]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DNevTfOo'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54d0259-8a78-40da-9451-24dbc80f7aac]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.067s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6337e1e4-f67f-45df-a306-376f2dbfa84a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5766d90a-a737-4a4b-a9aa-f6a0ebc2d292]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260]
Nov 14 08:04:48 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260] successful.
Nov 14 08:04:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac2b00-9757-4e16-b0f8-be4bda846c28]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dcce5d-df8f-4705-b78a-13bb84d34d95]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:48 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad1a55b-7235-4938-8a50-44712d22992f]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:04:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNevTfOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26462663262663435', 'path': '/dev/sdk'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462663262663435', 'path': '/dev/sdk'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:04:49 user nova-compute[75305]: DEBUG nova.objects.instance [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lazy-loading 'flavor' on Instance uuid 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 08:04:49 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:49 user nova-compute[75305]:   <source dev="/dev/sdk"/>
Nov 14 08:04:49 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:04:49 user nova-compute[75305]:   <serial>10bdb17b-c188-425a-8527-4e25dd037bc6</serial>
Nov 14 08:04:49 user nova-compute[75305]: </disk>
Nov 14 08:04:49 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:04:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:04:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] No VIF found with MAC fa:16:3e:85:71:0a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-729a1f8c-c2e6-4a4a-97db-001da991def5 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.664s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] volume_snapshot_create: create_info: {'snapshot_id': '7f354cda-e78d-4ea3-b5ea-df07b6f8dbc5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75305) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] snap xml: <domainsnapshot>
Nov 14 08:04:51 user nova-compute[75305]:   <disks>
Nov 14 08:04:51 user nova-compute[75305]:     <disk name="/dev/sdk" snapshot="external" type="file">
Nov 14 08:04:51 user nova-compute[75305]:       <source file="/dev/new_file"/>
Nov 14 08:04:51 user nova-compute[75305]:     </disk>
Nov 14 08:04:51 user nova-compute[75305]:     <disk name="vda" snapshot="no"/>
Nov 14 08:04:51 user nova-compute[75305]:   </disks>
Nov 14 08:04:51 user nova-compute[75305]: </domainsnapshot>
Nov 14 08:04:51 user nova-compute[75305]:  {{(pid=75305) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] Lazy-loading 'system_metadata' on Instance uuid 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:51 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     rv = execute(f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     six.reraise(c, e, tb)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     raise value
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     rv = meth(*args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     self._volume_snapshot_create(context, instance, guest,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     rv = execute(f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     six.reraise(c, e, tb)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     raise value
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     rv = meth(*args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] 
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2754b53-bb9f-47a5-8543-8b740b3b0fae tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] volume_snapshot_delete: delete_info: {'volume_id': '10bdb17b-c188-425a-8527-4e25dd037bc6'} {{(pid=75305) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [None req-e2754b53-bb9f-47a5-8543-8b740b3b0fae tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6]     if delete_info['type'] != 'qcow2':
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] KeyError: 'type'
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 7f354cda-e78d-4ea3-b5ea-df07b6f8dbc5 could not be found.
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 7f354cda-e78d-4ea3-b5ea-df07b6f8dbc5 could not be found. (HTTP 404) (Request-ID: req-245628d6-6cff-4b48-b29c-3b3348a159c8)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 7f354cda-e78d-4ea3-b5ea-df07b6f8dbc5 could not be found.
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server [None req-2a1b6d16-ea53-43b7-9113-ae171264fbdb tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver [None req-e2754b53-bb9f-47a5-8543-8b740b3b0fae tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-b9c32963-fa42-4830-adad-ce3cb2757656)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 08:04:51 user nova-compute[75305]: ERROR nova.virt.libvirt.driver 
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server [None req-e2754b53-bb9f-47a5-8543-8b740b3b0fae tempest-VolumesAssistedSnapshotsTest-1751219288 tempest-VolumesAssistedSnapshotsTest-1751219288-project] Exception during message handling: KeyError: 'type'
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 08:04:51 user nova-compute[75305]: ERROR oslo_messaging.rpc.server 
Nov 14 08:04:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:04:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:04:51 user nova-compute[75305]: INFO nova.compute.manager [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Detaching volume 10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:04:51 user nova-compute[75305]: INFO nova.virt.block_device [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Attempting to driver detach volume 10bdb17b-c188-425a-8527-4e25dd037bc6 from mountpoint /dev/vdb
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Attempting to detach device vdb from instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 08:04:51 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:51 user nova-compute[75305]:   <source dev="/dev/sdk"/>
Nov 14 08:04:51 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:04:51 user nova-compute[75305]:   <serial>10bdb17b-c188-425a-8527-4e25dd037bc6</serial>
Nov 14 08:04:51 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:04:51 user nova-compute[75305]: </disk>
Nov 14 08:04:51 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:04:51 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Successfully detached device vdb from instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 from the persistent domain config.
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 08:04:51 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:04:51 user nova-compute[75305]:   <source dev="/dev/sdk"/>
Nov 14 08:04:51 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:04:51 user nova-compute[75305]:   <serial>10bdb17b-c188-425a-8527-4e25dd037bc6</serial>
Nov 14 08:04:51 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:04:51 user nova-compute[75305]: </disk>
Nov 14 08:04:51 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:04:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:04:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:04:58 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 is timed out.
Nov 14 08:04:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Successfully detached device sdc from instance 9cc7b521-becf-40dc-bbef-fd6523e59b50 from the live domain config.
Nov 14 08:04:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LCzjhKSN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:04:58 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b261a7e2-2710-4b6b-9383-00ee20a57502]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:04:58 user nova-compute[75305]: No targets found.
Nov 14 08:04:58 user nova-compute[75305]: iSNS:
Nov 14 08:04:58 user nova-compute[75305]: No targets found.
Nov 14 08:04:58 user nova-compute[75305]: STATIC:
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e
Nov 14 08:04:58 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:04:58 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:04:58 user nova-compute[75305]: FIRMWARE:
Nov 14 08:04:58 user nova-compute[75305]: No targets found.
Nov 14 08:04:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:04:58 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:04:58 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6290772-c7ea-4e94-8e72-19382dfcd507]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46f6490-7a49-4f21-a767-d5599aed6605]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:04:58 user nova-compute[75305]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 (non-flash)
Nov 14 08:04:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442a83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8'): ({'sdi'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Removing single pathed devices sdi {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c0fa66-288c-49f5-9f7c-ebeaa23f6fd8]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[277d97e8-2696-47a5-8161-a3c5d6a44ea1]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Flushing IO for device /dev/sdi {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2703d54a-805d-4af8-95f5-a6e0b60eef95]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.043s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c06dd9-af5e-471c-a752-1895a986254f]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] SCSI volumes sdi have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9659947d-aa5a-49e9-bb7c-0a5e6d820d91]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[52355008-88db-4843-bc3a-9e75d857713f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260]
Nov 14 08:04:58 user nova-compute[75305]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8, portal: 172.16.0.220,3260] successful.
Nov 14 08:04:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be822b1-c599-49ec-9a09-5b79831a90f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a8e4e5-b922-479e-926d-8085481b1d76]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] <== disconnect_volume: return (358ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:04:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:04:59 user nova-compute[75305]: DEBUG nova.objects.instance [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lazy-loading 'flavor' on Instance uuid 9cc7b521-becf-40dc-bbef-fd6523e59b50 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:04:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-acc0b901-7f63-46ce-8a51-6595cd499747 tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.655s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:00 user nova-compute[75305]: INFO nova.compute.manager [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Terminating instance
Nov 14 08:05:00 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-20a21590-d07c-46c5-ac9c-eae1e03f43d0 req-ae19acb0-d512-4330-a3ad-a8561ce3366c service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-vif-unplugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-20a21590-d07c-46c5-ac9c-eae1e03f43d0 req-ae19acb0-d512-4330-a3ad-a8561ce3366c service nova] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-20a21590-d07c-46c5-ac9c-eae1e03f43d0 req-ae19acb0-d512-4330-a3ad-a8561ce3366c service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-20a21590-d07c-46c5-ac9c-eae1e03f43d0 req-ae19acb0-d512-4330-a3ad-a8561ce3366c service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-20a21590-d07c-46c5-ac9c-eae1e03f43d0 req-ae19acb0-d512-4330-a3ad-a8561ce3366c service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] No waiting events found dispatching network-vif-unplugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-20a21590-d07c-46c5-ac9c-eae1e03f43d0 req-ae19acb0-d512-4330-a3ad-a8561ce3366c service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-vif-unplugged-f47f5f90-3725-47e3-a576-90bce6f62f7f for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Instance destroyed successfully.
Nov 14 08:05:01 user nova-compute[75305]: DEBUG nova.objects.instance [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lazy-loading 'resources' on Instance uuid 9cc7b521-becf-40dc-bbef-fd6523e59b50 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-360004631',display_name='tempest-AttachSCSIVolumeTestJSON-server-360004631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-360004631',id=6,image_ref='39db806b-56f9-431d-a8ff-d7cae9a2e2a0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAeX958K7+3/TzrVw8k1UvKZHW9vxczAjXWLs0tUYa/O/sJ7fNmK1bnGtwPoeQr87rOT5F9QrCL5SFHD6QN+qBqiNluy0urjdjSRXWBwL+PGPHYDz8wRvhswmJHkpD4qEA==',key_name='tempest-keypair-1386826451',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='50d4081bd0d1409898c14ff5e16f23d6',ramdisk_id='',reservation_id='r-iy4v0vln',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='39db806b-56f9-431d-a8ff-d7cae9a2e2a0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1362657914',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1362657914-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='27651c0687384b53acf859ca6c7196c3',uuid=9cc7b521-becf-40dc-bbef-fd6523e59b50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Converting VIF {"id": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "address": "fa:16:3e:78:c1:39", "network": {"id": "62c40656-2bcc-4d32-b16e-b464500f89ed", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1830015294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "50d4081bd0d1409898c14ff5e16f23d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf47f5f90-37", "ovs_interfaceid": "f47f5f90-3725-47e3-a576-90bce6f62f7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:c1:39,bridge_name='br-int',has_traffic_filtering=True,id=f47f5f90-3725-47e3-a576-90bce6f62f7f,network=Network(62c40656-2bcc-4d32-b16e-b464500f89ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47f5f90-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG os_vif [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c1:39,bridge_name='br-int',has_traffic_filtering=True,id=f47f5f90-3725-47e3-a576-90bce6f62f7f,network=Network(62c40656-2bcc-4d32-b16e-b464500f89ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47f5f90-37') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf47f5f90-37, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c34a999-4417-445d-8c3f-a858ca8501b0) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:01 user nova-compute[75305]: INFO os_vif [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c1:39,bridge_name='br-int',has_traffic_filtering=True,id=f47f5f90-3725-47e3-a576-90bce6f62f7f,network=Network(62c40656-2bcc-4d32-b16e-b464500f89ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf47f5f90-37')
Nov 14 08:05:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Deleting instance files /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50_del
Nov 14 08:05:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Deletion of /opt/stack/data/nova/instances/9cc7b521-becf-40dc-bbef-fd6523e59b50_del complete
Nov 14 08:05:01 user nova-compute[75305]: INFO nova.compute.manager [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:01 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:01 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:02 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Took 0.88 seconds to deallocate network for instance.
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-changed-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing instance network info cache due to event network-changed-70845bae-b029-4cfd-be13-cf8a87d11911. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] Acquiring lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] Acquired lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.network.neutron [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Refreshing network info cache for port 70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:02 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Deleted allocations for instance 9cc7b521-becf-40dc-bbef-fd6523e59b50
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-93af4cb9-29ca-4aef-87b1-c04fde2b3c15 req-d2763bdf-1778-4733-ba70-6a8c9b687a85 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-93af4cb9-29ca-4aef-87b1-c04fde2b3c15 req-d2763bdf-1778-4733-ba70-6a8c9b687a85 service nova] Acquiring lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-93af4cb9-29ca-4aef-87b1-c04fde2b3c15 req-d2763bdf-1778-4733-ba70-6a8c9b687a85 service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-93af4cb9-29ca-4aef-87b1-c04fde2b3c15 req-d2763bdf-1778-4733-ba70-6a8c9b687a85 service nova] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-93af4cb9-29ca-4aef-87b1-c04fde2b3c15 req-d2763bdf-1778-4733-ba70-6a8c9b687a85 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] No waiting events found dispatching network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:02 user nova-compute[75305]: WARNING nova.compute.manager [req-93af4cb9-29ca-4aef-87b1-c04fde2b3c15 req-d2763bdf-1778-4733-ba70-6a8c9b687a85 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received unexpected event network-vif-plugged-f47f5f90-3725-47e3-a576-90bce6f62f7f for instance with vm_state deleted and task_state None.
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-93af4cb9-29ca-4aef-87b1-c04fde2b3c15 req-d2763bdf-1778-4733-ba70-6a8c9b687a85 service nova] [instance: 9cc7b521-becf-40dc-bbef-fd6523e59b50] Received event network-vif-deleted-f47f5f90-3725-47e3-a576-90bce6f62f7f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:02 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 is timed out.
Nov 14 08:05:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully detached device vdb from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the live domain config.
Nov 14 08:05:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItinHuhS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:02 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef36f4c8-4d65-4d41-a1a9-059af92d696e tempest-AttachSCSIVolumeTestJSON-1362657914 tempest-AttachSCSIVolumeTestJSON-1362657914-project-member] Lock "9cc7b521-becf-40dc-bbef-fd6523e59b50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.442s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a07935-ffcd-4b80-b849-5a787c2d5ed7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:02 user nova-compute[75305]: No targets found.
Nov 14 08:05:02 user nova-compute[75305]: iSNS:
Nov 14 08:05:02 user nova-compute[75305]: No targets found.
Nov 14 08:05:02 user nova-compute[75305]: STATIC:
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e
Nov 14 08:05:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:02 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:02 user nova-compute[75305]: No targets found.
Nov 14 08:05:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:02 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:02 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d73ae3c-c2f2-404d-afe5-151c5d8748a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d52b56c-de39-4441-aed6-07f3ea9fb5d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:05:02 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5c267010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09'): ({'sdj'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Removing single pathed devices sdj {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be2417b-bc9c-4c4b-b4c3-0736151ab1bc]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3b56b0-2351-4f71-b773-a8b44f14d8b8]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Flushing IO for device /dev/sdj {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10903880-3577-4481-ba6c-d16de62519cc]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0956ff-01af-458c-84d0-5553355c4af6]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] SCSI volumes sdj have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac636de8-e90e-48a4-b366-574520dbb2eb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f70617-b166-4635-8ee1-00225cff0b84]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260]
Nov 14 08:05:03 user nova-compute[75305]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:03 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d847c96-5548-434f-8f44-bf94eb10ee09 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90545eb2-7f1a-416e-a5b6-da01d679c311]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] <== disconnect_volume: return (347ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updated VIF entry in instance network info cache for port 70845bae-b029-4cfd-be13-cf8a87d11911. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [{"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cee544c-6146-4afd-9760-f9f56ebf4d85 req-7ea481a6-75b3-4214-8c44-4d42d72fe266 service nova] Releasing lock "refresh_cache-6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'flavor' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ca9837df-ef74-4061-a39c-c3f04891641d tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-changed-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing instance network info cache due to event network-changed-07ecf560-7926-48d7-a419-91293c5a8660. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] Acquiring lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] Acquired lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Refreshing network info cache for port 07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "interface-186a5286-ecc4-43e6-aea3-2529ddd72b58-252d2d44-8c0d-4941-b436-9894773fc7ab" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "interface-186a5286-ecc4-43e6-aea3-2529ddd72b58-252d2d44-8c0d-4941-b436-9894773fc7ab" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.objects.instance [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'flavor' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converting VIF {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface> {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface> {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Attempting to detach device tap252d2d44-8c from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] detach device xml: <interface type="ethernet">
Nov 14 08:05:04 user nova-compute[75305]:   <mac address="fa:16:3e:05:13:0e"/>
Nov 14 08:05:04 user nova-compute[75305]:   <model type="virtio"/>
Nov 14 08:05:04 user nova-compute[75305]:   <mtu size="1442"/>
Nov 14 08:05:04 user nova-compute[75305]:   <target dev="tap252d2d44-8c"/>
Nov 14 08:05:04 user nova-compute[75305]: </interface>
Nov 14 08:05:04 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface> {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 08:05:04 user nova-compute[75305]:   <name>instance-00000007</name>
Nov 14 08:05:04 user nova-compute[75305]:   <uuid>186a5286-ecc4-43e6-aea3-2529ddd72b58</uuid>
Nov 14 08:05:04 user nova-compute[75305]:   <metadata>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:05:04 user nova-compute[75305]:   <nova:package version="0.0.0"/>
Nov 14 08:05:04 user nova-compute[75305]:   <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:05:04 user nova-compute[75305]:   <nova:creationTime>2023-11-14 08:04:33</nova:creationTime>
Nov 14 08:05:04 user nova-compute[75305]:   <nova:flavor name="m1.tiny">
Nov 14 08:05:04 user nova-compute[75305]:     <nova:memory>512</nova:memory>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:disk>1</nova:disk>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:swap>0</nova:swap>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:vcpus>1</nova:vcpus>
Nov 14 08:05:04 user nova-compute[75305]:   </nova:flavor>
Nov 14 08:05:04 user nova-compute[75305]:   <nova:owner>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:05:04 user nova-compute[75305]:   </nova:owner>
Nov 14 08:05:04 user nova-compute[75305]:   <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:05:04 user nova-compute[75305]:   <nova:ports>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:05:04 user nova-compute[75305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:05:04 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:04 user nova-compute[75305]:     <nova:port uuid="252d2d44-8c0d-4941-b436-9894773fc7ab">
Nov 14 08:05:04 user nova-compute[75305]:       <nova:ip type="fixed" address="10.10.10.168" ipVersion="4"/>
Nov 14 08:05:04 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:04 user nova-compute[75305]:   </nova:ports>
Nov 14 08:05:04 user nova-compute[75305]: </nova:instance>
Nov 14 08:05:04 user nova-compute[75305]:   </metadata>
Nov 14 08:05:04 user nova-compute[75305]:   <memory unit='KiB'>524288</memory>
Nov 14 08:05:04 user nova-compute[75305]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 08:05:04 user nova-compute[75305]:   <vcpu placement='static'>1</vcpu>
Nov 14 08:05:04 user nova-compute[75305]:   <resource>
Nov 14 08:05:04 user nova-compute[75305]:     <partition>/machine</partition>
Nov 14 08:05:04 user nova-compute[75305]:   </resource>
Nov 14 08:05:04 user nova-compute[75305]:   <sysinfo type='smbios'>
Nov 14 08:05:04 user nova-compute[75305]:     <system>
Nov 14 08:05:04 user nova-compute[75305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 08:05:04 user nova-compute[75305]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 08:05:04 user nova-compute[75305]:       <entry name='version'>0.0.0</entry>
Nov 14 08:05:04 user nova-compute[75305]:       <entry name='serial'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:04 user nova-compute[75305]:       <entry name='uuid'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:04 user nova-compute[75305]:       <entry name='family'>Virtual Machine</entry>
Nov 14 08:05:04 user nova-compute[75305]:     </system>
Nov 14 08:05:04 user nova-compute[75305]:   </sysinfo>
Nov 14 08:05:04 user nova-compute[75305]:   <os>
Nov 14 08:05:04 user nova-compute[75305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 08:05:04 user nova-compute[75305]:     <boot dev='hd'/>
Nov 14 08:05:04 user nova-compute[75305]:     <smbios mode='sysinfo'/>
Nov 14 08:05:04 user nova-compute[75305]:   </os>
Nov 14 08:05:04 user nova-compute[75305]:   <features>
Nov 14 08:05:04 user nova-compute[75305]:     <acpi/>
Nov 14 08:05:04 user nova-compute[75305]:     <apic/>
Nov 14 08:05:04 user nova-compute[75305]:     <vmcoreinfo state='on'/>
Nov 14 08:05:04 user nova-compute[75305]:   </features>
Nov 14 08:05:04 user nova-compute[75305]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 08:05:04 user nova-compute[75305]:     <model fallback='forbid'>Nehalem</model>
Nov 14 08:05:04 user nova-compute[75305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 08:05:04 user nova-compute[75305]:     <feature policy='require' name='vme'/>
Nov 14 08:05:04 user nova-compute[75305]:     <feature policy='require' name='x2apic'/>
Nov 14 08:05:04 user nova-compute[75305]:     <feature policy='require' name='hypervisor'/>
Nov 14 08:05:04 user nova-compute[75305]:   </cpu>
Nov 14 08:05:04 user nova-compute[75305]:   <clock offset='utc'>
Nov 14 08:05:04 user nova-compute[75305]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 08:05:04 user nova-compute[75305]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 08:05:04 user nova-compute[75305]:     <timer name='hpet' present='no'/>
Nov 14 08:05:04 user nova-compute[75305]:   </clock>
Nov 14 08:05:04 user nova-compute[75305]:   <on_poweroff>destroy</on_poweroff>
Nov 14 08:05:04 user nova-compute[75305]:   <on_reboot>restart</on_reboot>
Nov 14 08:05:04 user nova-compute[75305]:   <on_crash>destroy</on_crash>
Nov 14 08:05:04 user nova-compute[75305]:   <devices>
Nov 14 08:05:04 user nova-compute[75305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 08:05:04 user nova-compute[75305]:     <disk type='file' device='disk'>
Nov 14 08:05:04 user nova-compute[75305]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 08:05:04 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk' index='2'/>
Nov 14 08:05:04 user nova-compute[75305]:       <backingStore type='file' index='3'>
Nov 14 08:05:04 user nova-compute[75305]:         <format type='raw'/>
Nov 14 08:05:04 user nova-compute[75305]:         <source file='/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48'/>
Nov 14 08:05:04 user nova-compute[75305]:         <backingStore/>
Nov 14 08:05:04 user nova-compute[75305]:       </backingStore>
Nov 14 08:05:04 user nova-compute[75305]:       <target dev='vda' bus='virtio'/>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='virtio-disk0'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </disk>
Nov 14 08:05:04 user nova-compute[75305]:     <disk type='file' device='cdrom'>
Nov 14 08:05:04 user nova-compute[75305]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 08:05:04 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config' index='1'/>
Nov 14 08:05:04 user nova-compute[75305]:       <backingStore/>
Nov 14 08:05:04 user nova-compute[75305]:       <target dev='hda' bus='ide'/>
Nov 14 08:05:04 user nova-compute[75305]:       <readonly/>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='ide0-0-0'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </disk>
Nov 14 08:05:04 user nova-compute[75305]:     <controller type='usb' index='0' model='none'>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='usb'/>
Nov 14 08:05:04 user nova-compute[75305]:     </controller>
Nov 14 08:05:04 user nova-compute[75305]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='pci.0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </controller>
Nov 14 08:05:04 user nova-compute[75305]:     <controller type='ide' index='0'>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='ide'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 08:05:04 user nova-compute[75305]:     </controller>
Nov 14 08:05:04 user nova-compute[75305]:     <interface type='ethernet'>
Nov 14 08:05:04 user nova-compute[75305]:       <mac address='fa:16:3e:74:b6:cb'/>
Nov 14 08:05:04 user nova-compute[75305]:       <target dev='tap88edc6a5-97'/>
Nov 14 08:05:04 user nova-compute[75305]:       <model type='virtio'/>
Nov 14 08:05:04 user nova-compute[75305]:       <mtu size='1442'/>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='net0'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </interface>
Nov 14 08:05:04 user nova-compute[75305]:     <interface type='ethernet'>
Nov 14 08:05:04 user nova-compute[75305]:       <mac address='fa:16:3e:05:13:0e'/>
Nov 14 08:05:04 user nova-compute[75305]:       <target dev='tap252d2d44-8c'/>
Nov 14 08:05:04 user nova-compute[75305]:       <model type='virtio'/>
Nov 14 08:05:04 user nova-compute[75305]:       <mtu size='1442'/>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='net1'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </interface>
Nov 14 08:05:04 user nova-compute[75305]:     <serial type='pty'>
Nov 14 08:05:04 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:04 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:04 user nova-compute[75305]:       <target type='isa-serial' port='0'>
Nov 14 08:05:04 user nova-compute[75305]:         <model name='isa-serial'/>
Nov 14 08:05:04 user nova-compute[75305]:       </target>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </serial>
Nov 14 08:05:04 user nova-compute[75305]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 08:05:04 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:04 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:04 user nova-compute[75305]:       <target type='serial' port='0'/>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </console>
Nov 14 08:05:04 user nova-compute[75305]:     <input type='mouse' bus='ps2'>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='input0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </input>
Nov 14 08:05:04 user nova-compute[75305]:     <input type='keyboard' bus='ps2'>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='input1'/>
Nov 14 08:05:04 user nova-compute[75305]:     </input>
Nov 14 08:05:04 user nova-compute[75305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 08:05:04 user nova-compute[75305]:       <listen type='address' address='0.0.0.0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </graphics>
Nov 14 08:05:04 user nova-compute[75305]:     <audio id='1' type='none'/>
Nov 14 08:05:04 user nova-compute[75305]:     <video>
Nov 14 08:05:04 user nova-compute[75305]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='video0'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </video>
Nov 14 08:05:04 user nova-compute[75305]:     <memballoon model='virtio'>
Nov 14 08:05:04 user nova-compute[75305]:       <stats period='10'/>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='balloon0'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </memballoon>
Nov 14 08:05:04 user nova-compute[75305]:     <rng model='virtio'>
Nov 14 08:05:04 user nova-compute[75305]:       <backend model='random'>/dev/urandom</backend>
Nov 14 08:05:04 user nova-compute[75305]:       <alias name='rng0'/>
Nov 14 08:05:04 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 08:05:04 user nova-compute[75305]:     </rng>
Nov 14 08:05:04 user nova-compute[75305]:   </devices>
Nov 14 08:05:04 user nova-compute[75305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 08:05:04 user nova-compute[75305]:     <label>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</label>
Nov 14 08:05:04 user nova-compute[75305]:     <imagelabel>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</imagelabel>
Nov 14 08:05:04 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:04 user nova-compute[75305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 08:05:04 user nova-compute[75305]:     <label>+64055:+108</label>
Nov 14 08:05:04 user nova-compute[75305]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 08:05:04 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:04 user nova-compute[75305]: </domain>
Nov 14 08:05:04 user nova-compute[75305]:  {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 08:05:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully detached device tap252d2d44-8c from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the persistent domain config.
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] (1/8): Attempting to detach device tap252d2d44-8c with device alias net1 from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] detach device xml: <interface type="ethernet">
Nov 14 08:05:04 user nova-compute[75305]:   <mac address="fa:16:3e:05:13:0e"/>
Nov 14 08:05:04 user nova-compute[75305]:   <model type="virtio"/>
Nov 14 08:05:04 user nova-compute[75305]:   <mtu size="1442"/>
Nov 14 08:05:04 user nova-compute[75305]:   <target dev="tap252d2d44-8c"/>
Nov 14 08:05:04 user nova-compute[75305]: </interface>
Nov 14 08:05:04 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updated VIF entry in instance network info cache for port 07ecf560-7926-48d7-a419-91293c5a8660. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [{"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48ffa0a5-0824-4cc6-9b26-4bcda14a3689 req-ac63cc25-9f28-4062-8619-d1c70adaaba8 service nova] Releasing lock "refresh_cache-2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Start waiting for the detach event from libvirt for device tap252d2d44-8c with device alias net1 for instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-0b660d61-8251-4395-95c7-6213cbba6579 req-6be43a40-b849-4050-a254-260934078a0f service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-unplugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0b660d61-8251-4395-95c7-6213cbba6579 req-6be43a40-b849-4050-a254-260934078a0f service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0b660d61-8251-4395-95c7-6213cbba6579 req-6be43a40-b849-4050-a254-260934078a0f service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0b660d61-8251-4395-95c7-6213cbba6579 req-6be43a40-b849-4050-a254-260934078a0f service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-0b660d61-8251-4395-95c7-6213cbba6579 req-6be43a40-b849-4050-a254-260934078a0f service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-unplugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:05 user nova-compute[75305]: WARNING nova.compute.manager [req-0b660d61-8251-4395-95c7-6213cbba6579 req-6be43a40-b849-4050-a254-260934078a0f service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received unexpected event network-vif-unplugged-252d2d44-8c0d-4941-b436-9894773fc7ab for instance with vm_state active and task_state None.
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:05 user nova-compute[75305]: INFO nova.compute.manager [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Terminating instance
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:05 user nova-compute[75305]: INFO nova.compute.manager [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Terminating instance
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-885e8bf8-2e7b-46dd-8bab-324a7fba6a86 req-16265544-4b62-4fb0-bde1-c1ee8bf80848 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-885e8bf8-2e7b-46dd-8bab-324a7fba6a86 req-16265544-4b62-4fb0-bde1-c1ee8bf80848 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-885e8bf8-2e7b-46dd-8bab-324a7fba6a86 req-16265544-4b62-4fb0-bde1-c1ee8bf80848 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-885e8bf8-2e7b-46dd-8bab-324a7fba6a86 req-16265544-4b62-4fb0-bde1-c1ee8bf80848 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-885e8bf8-2e7b-46dd-8bab-324a7fba6a86 req-16265544-4b62-4fb0-bde1-c1ee8bf80848 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-unplugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-885e8bf8-2e7b-46dd-8bab-324a7fba6a86 req-16265544-4b62-4fb0-bde1-c1ee8bf80848 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Instance destroyed successfully.
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.objects.instance [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lazy-loading 'resources' on Instance uuid 32a98fdb-39f7-496a-95f9-6bcd1606a2fe {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1237238910',display_name='tempest-VolumesNegativeTest-instance-1237238910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1237238910',id=12,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='529f4831f7cb46c6961e4de5686cff3f',ramdisk_id='',reservation_id='r-oitcqh4q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1979521520',owner_user_name='tempest-VolumesNegativeTest-1979521520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:26Z,user_data=None,user_id='ec8ff38db0914074978d7af10d537059',uuid=32a98fdb-39f7-496a-95f9-6bcd1606a2fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Converting VIF {"id": "b0be203d-c34a-4c13-8705-f6efe37cba10", "address": "fa:16:3e:54:ab:d9", "network": {"id": "5632be66-739d-47c0-8f62-ef73620a0227", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f9ce0c6c5ee44fcf9bd9225002b5f446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0be203d-c3", "ovs_interfaceid": "b0be203d-c34a-4c13-8705-f6efe37cba10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:ab:d9,bridge_name='br-int',has_traffic_filtering=True,id=b0be203d-c34a-4c13-8705-f6efe37cba10,network=Network(5632be66-739d-47c0-8f62-ef73620a0227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0be203d-c3') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG os_vif [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ab:d9,bridge_name='br-int',has_traffic_filtering=True,id=b0be203d-c34a-4c13-8705-f6efe37cba10,network=Network(5632be66-739d-47c0-8f62-ef73620a0227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0be203d-c3') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0be203d-c3, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2834fbf-6f4d-4a59-957d-ba0ab6ed5080) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received event network-vif-unplugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Acquiring lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] No waiting events found dispatching network-vif-unplugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received event network-vif-unplugged-b0be203d-c34a-4c13-8705-f6efe37cba10 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received event network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Acquiring lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] No waiting events found dispatching network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:06 user nova-compute[75305]: WARNING nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received unexpected event network-vif-plugged-b0be203d-c34a-4c13-8705-f6efe37cba10 for instance with vm_state active and task_state deleting.
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-unplugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-e0b79350-e4fb-4c5f-919e-f29efceb386b for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:06 user nova-compute[75305]: WARNING nova.compute.manager [req-812c9ff9-a819-4719-851a-c772ce8a9df7 req-9de02dea-e49c-411c-94aa-31cfe3ec58e2 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-e0b79350-e4fb-4c5f-919e-f29efceb386b for instance with vm_state active and task_state deleting.
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: INFO os_vif [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:ab:d9,bridge_name='br-int',has_traffic_filtering=True,id=b0be203d-c34a-4c13-8705-f6efe37cba10,network=Network(5632be66-739d-47c0-8f62-ef73620a0227),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0be203d-c3')
Nov 14 08:05:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Deleting instance files /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe_del
Nov 14 08:05:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Deletion of /opt/stack/data/nova/instances/32a98fdb-39f7-496a-95f9-6bcd1606a2fe_del complete
Nov 14 08:05:06 user nova-compute[75305]: INFO nova.compute.manager [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Terminating instance
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:06 user nova-compute[75305]: INFO nova.compute.manager [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG nova.objects.instance [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'flavor' on Instance uuid 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Ignoring supplied device name: /dev/vdb
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.102s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:07 user nova-compute[75305]: INFO nova.compute.manager [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Attaching volume c28655e8-34c2-49a2-8334-4728348c6d4a to /dev/vdb
Nov 14 08:05:07 user nova-compute[75305]: DEBUG os_brick.utils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Instance destroyed successfully.
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.objects.instance [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lazy-loading 'resources' on Instance uuid 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[064e5905-9f1f-4c61-87aa-b6afe0c3a39e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:72:91,bridge_name='br-int',has_traffic_filtering=True,id=70845bae-b029-4cfd-be13-cf8a87d11911,network=Network(68640d53-8d65-494d-a493-34c5e4ade60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70845bae-b0') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:72:91,bridge_name='br-int',has_traffic_filtering=True,id=70845bae-b029-4cfd-be13-cf8a87d11911,network=Network(68640d53-8d65-494d-a493-34c5e4ade60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70845bae-b0') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44d0757-d658-45f2-99d0-d16c6f149988]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70845bae-b0, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61f78b6-065a-45a7-863f-cb091241c687]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[283bb829-775b-4aa1-9cab-3abc1b9b0d84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:05:07 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a7b50-2901-46ce-a219-519e2afefa29]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG os_brick.utils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updating existing volume attachment record: 360506d4-3f71-4be1-b0e4-f42a02525851 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:07 user nova-compute[75305]: WARNING nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received unexpected event network-vif-plugged-252d2d44-8c0d-4941-b436-9894773fc7ab for instance with vm_state active and task_state None.
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-unplugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-70845bae-b029-4cfd-be13-cf8a87d11911 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:07 user nova-compute[75305]: WARNING nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-70845bae-b029-4cfd-be13-cf8a87d11911 for instance with vm_state active and task_state deleting.
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-unplugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e517ed6-8e98-467c-babd-f6c8b64d0ef1 req-2dbed8f2-acf6-4150-8286-4f2984c9f767 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-07ecf560-7926-48d7-a419-91293c5a8660 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:07 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Took 0.88 seconds to deallocate network for instance.
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=282ef213-8370-442e-b930-da43fe858d86) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-e5d10339-70e7-42b6-9a02-9a4b4c59b845 for instance with vm_state active and task_state deleting.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-changed-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Refreshing instance network info cache due to event network-changed-43bdf938-f392-40d2-9a72-46930577a7f0. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquired lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.neutron [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Refreshing network info cache for port 43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:08 user nova-compute[75305]: INFO os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:72:91,bridge_name='br-int',has_traffic_filtering=True,id=70845bae-b029-4cfd-be13-cf8a87d11911,network=Network(68640d53-8d65-494d-a493-34c5e4ade60b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70845bae-b0')
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:00,bridge_name='br-int',has_traffic_filtering=True,id=e5d10339-70e7-42b6-9a02-9a4b4c59b845,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5d10339-70') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:00,bridge_name='br-int',has_traffic_filtering=True,id=e5d10339-70e7-42b6-9a02-9a4b4c59b845,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5d10339-70') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5d10339-70, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Deleted allocations for instance 32a98fdb-39f7-496a-95f9-6bcd1606a2fe
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fefb2f4e-db8f-4625-bdd2-9fbf5d8d18ea tempest-VolumesNegativeTest-1979521520 tempest-VolumesNegativeTest-1979521520-project-member] Lock "32a98fdb-39f7-496a-95f9-6bcd1606a2fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df1ed355-6b90-4773-bc32-77f61ced4d9b) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Instance destroyed successfully.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.objects.instance [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lazy-loading 'resources' on Instance uuid 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:2e:24,bridge_name='br-int',has_traffic_filtering=True,id=07ecf560-7926-48d7-a419-91293c5a8660,network=Network(a773e639-a8dc-426b-97f6-b6325f50e56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ecf560-79') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:2e:24,bridge_name='br-int',has_traffic_filtering=True,id=07ecf560-7926-48d7-a419-91293c5a8660,network=Network(a773e639-a8dc-426b-97f6-b6325f50e56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ecf560-79') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-unplugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-9b357b6e-c138-46c0-8fc3-5ab8d5e09709 for instance with vm_state active and task_state deleting.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-unplugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-848a7a02-afae-41f9-a7d6-59cd81ffb56f for instance with vm_state active and task_state deleting.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-unplugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-5f93709c-024d-4406-bf37-8db387c5a6e8 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-5f93709c-024d-4406-bf37-8db387c5a6e8 for instance with vm_state active and task_state deleting.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-unplugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-5d7a4009-ce6c-41d6-b8e3-c9b177534d8c req-74c65dce-4141-4d8c-9617-d0ebaf0021dc service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-b9b49c6d-8100-47af-8133-736ba3e1bde2 for instance with vm_state active and task_state deleting.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap07ecf560-79, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: INFO os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:70:00,bridge_name='br-int',has_traffic_filtering=True,id=e5d10339-70e7-42b6-9a02-9a4b4c59b845,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape5d10339-70')
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:1e:0d,bridge_name='br-int',has_traffic_filtering=True,id=9b357b6e-c138-46c0-8fc3-5ab8d5e09709,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b357b6e-c1') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1e:0d,bridge_name='br-int',has_traffic_filtering=True,id=9b357b6e-c138-46c0-8fc3-5ab8d5e09709,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b357b6e-c1') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b357b6e-c1, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.neutron [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updated VIF entry in instance network info cache for port 43bdf938-f392-40d2-9a72-46930577a7f0. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.network.neutron [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updating instance_info_cache with network_info: [{"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Releasing lock "refresh_cache-91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-unplugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-bb47e777-8726-47e9-ad11-70af908c61b0 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-bb47e777-8726-47e9-ad11-70af908c61b0 for instance with vm_state active and task_state deleting.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-unplugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 32a98fdb-39f7-496a-95f9-6bcd1606a2fe] Received event network-vif-deleted-b0be203d-c34a-4c13-8705-f6efe37cba10 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 for instance with vm_state active and task_state deleting.
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-unplugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-unplugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Acquiring lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] No waiting events found dispatching network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:08 user nova-compute[75305]: WARNING nova.compute.manager [req-3e4f8c07-632d-43e8-ad39-d5cde07b3b88 req-f8491602-7573-43dc-a293-197ac7cb9d50 service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received unexpected event network-vif-plugged-0ee8e7e1-3696-4af5-9402-187894a1fe99 for instance with vm_state active and task_state deleting.
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e5e59f5-9dd3-4761-b339-107a2f06d35f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=42e7ef48-7b8d-4da8-9e9d-5ed7c13cddc5) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: INFO os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:2e:24,bridge_name='br-int',has_traffic_filtering=True,id=07ecf560-7926-48d7-a419-91293c5a8660,network=Network(a773e639-a8dc-426b-97f6-b6325f50e56f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap07ecf560-79')
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:0a:3d,bridge_name='br-int',has_traffic_filtering=True,id=848a7a02-afae-41f9-a7d6-59cd81ffb56f,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap848a7a02-af') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:0a:3d,bridge_name='br-int',has_traffic_filtering=True,id=848a7a02-afae-41f9-a7d6-59cd81ffb56f,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap848a7a02-af') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap848a7a02-af, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: INFO os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:1e:0d,bridge_name='br-int',has_traffic_filtering=True,id=9b357b6e-c138-46c0-8fc3-5ab8d5e09709,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9b357b6e-c1')
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:8e:c6,bridge_name='br-int',has_traffic_filtering=True,id=e0b79350-e4fb-4c5f-919e-f29efceb386b,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b79350-e4') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:8e:c6,bridge_name='br-int',has_traffic_filtering=True,id=e0b79350-e4fb-4c5f-919e-f29efceb386b,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b79350-e4') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0b79350-e4, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d18b80e5-7333-4302-b757-7e75b34ff3a5) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=568c3372-97d0-48c6-a087-a4da6c644bfd) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: INFO os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:0a:3d,bridge_name='br-int',has_traffic_filtering=True,id=848a7a02-afae-41f9-a7d6-59cd81ffb56f,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap848a7a02-af')
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=b9b49c6d-8100-47af-8133-736ba3e1bde2,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9b49c6d-81') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=b9b49c6d-8100-47af-8133-736ba3e1bde2,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9b49c6d-81') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:09 user nova-compute[75305]: WARNING nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-07ecf560-7926-48d7-a419-91293c5a8660 for instance with vm_state active and task_state deleting.
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-unplugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-a4a1142a-6df6-43cb-ab40-73583596e249 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:09 user nova-compute[75305]: WARNING nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-a4a1142a-6df6-43cb-ab40-73583596e249 for instance with vm_state active and task_state deleting.
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-unplugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-67ab3e90-3507-4776-883c-8bb583491e1c for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:09 user nova-compute[75305]: WARNING nova.compute.manager [req-8cf9ed55-01cc-4429-8c18-ef74aa60c75e req-69d4cd7d-09c2-4de5-9f16-c50ebe845176 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-67ab3e90-3507-4776-883c-8bb583491e1c for instance with vm_state active and task_state deleting.
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9b49c6d-81, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: INFO os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:8e:c6,bridge_name='br-int',has_traffic_filtering=True,id=e0b79350-e4fb-4c5f-919e-f29efceb386b,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0b79350-e4')
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "address": "fa:16:3e:42:24:ad", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.179", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7afc5aa-63", "ovs_interfaceid": "a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7afc5aa-63') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7afc5aa-63') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7afc5aa-63, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1bae363-dbfe-4766-98c0-e7beae1bea07) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39872794-a1a7-4948-b7c9-65ec56b0e701) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: INFO os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:d7:29,bridge_name='br-int',has_traffic_filtering=True,id=b9b49c6d-8100-47af-8133-736ba3e1bde2,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb9b49c6d-81')
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:95:ae,bridge_name='br-int',has_traffic_filtering=True,id=5f93709c-024d-4406-bf37-8db387c5a6e8,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f93709c-02') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:95:ae,bridge_name='br-int',has_traffic_filtering=True,id=5f93709c-024d-4406-bf37-8db387c5a6e8,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f93709c-02') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f93709c-02, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: INFO os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:24:ad,bridge_name='br-int',has_traffic_filtering=True,id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8,network=Network(d675d8fe-3620-4ae4-8833-5711a3105458),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7afc5aa-63')
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:43:8f,bridge_name='br-int',has_traffic_filtering=True,id=bb47e777-8726-47e9-ad11-70af908c61b0,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47e777-87') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:43:8f,bridge_name='br-int',has_traffic_filtering=True,id=bb47e777-8726-47e9-ad11-70af908c61b0,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47e777-87') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb47e777-87, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6e2af7e-7d87-479f-ab1e-02262f8ba1be) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62dc9656-12c6-4d4a-bd84-a4b81b8444f0) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: INFO os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:95:ae,bridge_name='br-int',has_traffic_filtering=True,id=5f93709c-024d-4406-bf37-8db387c5a6e8,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f93709c-02')
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:29:78,bridge_name='br-int',has_traffic_filtering=True,id=a4a1142a-6df6-43cb-ab40-73583596e249,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a1142a-6d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:29:78,bridge_name='br-int',has_traffic_filtering=True,id=a4a1142a-6df6-43cb-ab40-73583596e249,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a1142a-6d') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4a1142a-6d, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: INFO os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:43:8f,bridge_name='br-int',has_traffic_filtering=True,id=bb47e777-8726-47e9-ad11-70af908c61b0,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb47e777-87')
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1709220993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1709220993',id=9,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDLyXafDqHZNTA9rdl8jVc1gUlxDS0g2NXjqEX3kHyJNiua52mmOikYMDfv16/1yQZibdDfT1I9NrYvWRjymnGUo0gmkKNgLFdS1mP5kvYIxuuf4kV1a9+fFV1fhb0lBTg==',key_name='tempest-keypair-1848579157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e2fefab86d9b4003a2f1ea8035d28f3b',ramdisk_id='',reservation_id='r-8st2yxps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1568364879',owner_user_name='tempest-TaggedBootDevicesTest_v242-1568364879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa273fed7dfa49388ab3ca92f1061d18',uuid=6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converting VIF {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:22:81,bridge_name='br-int',has_traffic_filtering=True,id=0ee8e7e1-3696-4af5-9402-187894a1fe99,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee8e7e1-36') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:22:81,bridge_name='br-int',has_traffic_filtering=True,id=0ee8e7e1-3696-4af5-9402-187894a1fe99,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee8e7e1-36') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ee8e7e1-36, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=01548529-32cb-459a-869e-10da26a54166) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-unplugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-unplugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] Acquiring lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] No waiting events found dispatching network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:10 user nova-compute[75305]: WARNING nova.compute.manager [req-a4147b7c-77e2-46d4-a162-e67a6edc09bb req-9c152c09-f59b-45dc-958b-6d58ac344aeb service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received unexpected event network-vif-plugged-7966bbc1-c5cf-4215-a0f0-39382b12dda7 for instance with vm_state active and task_state deleting.
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d814948-1c52-405b-8ef7-d6f56ae258af) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: INFO os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:29:78,bridge_name='br-int',has_traffic_filtering=True,id=a4a1142a-6df6-43cb-ab40-73583596e249,network=Network(20c248b6-3326-45a9-b48a-d77cf4921f96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a1142a-6d')
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:bb:d2,bridge_name='br-int',has_traffic_filtering=True,id=67ab3e90-3507-4776-883c-8bb583491e1c,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab3e90-35') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:bb:d2,bridge_name='br-int',has_traffic_filtering=True,id=67ab3e90-3507-4776-883c-8bb583491e1c,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab3e90-35') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67ab3e90-35, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: INFO os_vif [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:22:81,bridge_name='br-int',has_traffic_filtering=True,id=0ee8e7e1-3696-4af5-9402-187894a1fe99,network=Network(503f0ead-7f71-4961-8f19-058ea182d477),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ee8e7e1-36')
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlcaniHo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:10 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a37d3ce-7f5a-43ca-9ac6-80927b992e6c) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c3547b-c62d-414d-9f66-92eb360227d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]: iSNS:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]: STATIC:
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:10 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:10 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: INFO os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:bb:d2,bridge_name='br-int',has_traffic_filtering=True,id=67ab3e90-3507-4776-883c-8bb583491e1c,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67ab3e90-35')
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:03:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035969857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035969857',id=10,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyPz4rQCl+ZzPMOOfwC2T7KktGR9+gnytPzlEEhOteUhAqQ0fU1gkIOrrYBl+NDoN6d+s5oXwg0sCEa6RjlgGTSBgJngBHbPV2Esqh1UwmqoaURWQST2FWrl9zfxlN2Ew==',key_name='tempest-keypair-2098376710',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='75bf7951de484ad6b5296e643847583a',ramdisk_id='',reservation_id='r-bjnboczc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1271835931',owner_user_name='tempest-TaggedBootDevicesTest-1271835931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fed94e69e6b44903998b824566f85db2',uuid=2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converting VIF {"id": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "address": "fa:16:3e:ae:fa:93", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7966bbc1-c5", "ovs_interfaceid": "7966bbc1-c5cf-4215-a0f0-39382b12dda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:fa:93,bridge_name='br-int',has_traffic_filtering=True,id=7966bbc1-c5cf-4215-a0f0-39382b12dda7,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7966bbc1-c5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:fa:93,bridge_name='br-int',has_traffic_filtering=True,id=7966bbc1-c5cf-4215-a0f0-39382b12dda7,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7966bbc1-c5') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7966bbc1-c5, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1301e319-9de3-4d0f-afd4-9f2ee6478eba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c09027fe-0614-45d6-857e-e2dcb50596a3) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:05:10 user nova-compute[75305]: INFO os_vif [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:fa:93,bridge_name='br-int',has_traffic_filtering=True,id=7966bbc1-c5cf-4215-a0f0-39382b12dda7,network=Network(ff32a521-cf53-4a63-b0d3-3bc63f935ec3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7966bbc1-c5')
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad553f77-54ca-4a97-b04f-f54fa3f5ca54]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542a9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZQFlKRxp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:10 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea61872-0ac2-4ff7-abe3-314d6072966e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb28d1f-2dcc-429a-bd07-c28ee8dc9ca1]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c983ba2-3a99-4f63-b9bb-b924a29edf2b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b674e7-d85b-4915-a53a-78a42c33cf2d]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[492b6731-75e4-48eb-8479-ee88485824b9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d99ba51-1ae5-402c-96a4-51948bc3cb82]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260]
Nov 14 08:05:10 user nova-compute[75305]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b5f3219-e0d2-4184-8488-6a4795c69456 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b823fe-62ae-4127-8a0b-ea810d17ba22]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== disconnect_volume: return (335ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.246s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CftcSrXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:10 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acf2d21-4ec8-490c-9686-5a462d65fbb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]: iSNS:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]: STATIC:
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:10 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:10 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80651d5-8423-4be2-9ba0-30d3e702131a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc7594-c000-4226-98c2-a24e2131371a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5e5e3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e'): ({'sdg'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Removing single pathed devices sdg {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362d382-e8ad-43b2-8200-87ef1fdb92db]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8c35c-b6ac-44d4-af05-084845e6dbaf]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Flushing IO for device /dev/sdg {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14d9cfd-d8b9-43b7-acd9-65a64d2ee454]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea9e96f-4805-417d-9c07-fe9f5a82e01f]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] SCSI volumes sdg have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73bfd5-44df-4dde-90b8-ca514088afde]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197e0a2-a945-43ff-b7b4-f6e9a1f2926d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260]
Nov 14 08:05:10 user nova-compute[75305]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cd7f475-0e4e-4464-96be-db4080f6908e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1551154e-2f2b-4933-bfbd-e423effd762c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== disconnect_volume: return (556ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.306s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POblDGeZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:10 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb2bb60-cb5e-43e1-bcd6-3189c977f32a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]: iSNS:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]: STATIC:
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e
Nov 14 08:05:10 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:10 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:10 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:10 user nova-compute[75305]: No targets found.
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:10 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:10 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c520d-6adf-42b4-9359-428cec664597]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0d8fc8-1e67-49aa-8941-c70577f4a7f5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e (non-flash)
Nov 14 08:05:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5e5e3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e'): ({'sdf'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Removing single pathed devices sdf {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[823a62a2-2b44-43d1-b544-b91f3fdd7e39]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23cf2da-34b9-488e-b7ac-817cc00afcd4]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Flushing IO for device /dev/sdf {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac7c86-377f-4647-8d99-eb893c5ac250]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dd605c-a924-49cf-a23c-b912c21829d4]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.082s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fc4c2b-a018-4a15-92e8-1a7ef3382c63]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1122d3-531c-45ab-b189-90914f51b675]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260]
Nov 14 08:05:11 user nova-compute[75305]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ae7754e-9b19-4359-ba45-4ee055d8b06e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c831b4-042e-401f-acf7-99b27a41b18e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== disconnect_volume: return (669ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.361s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihtkaDZy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:11 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f054d45-13d1-4a89-b2c9-20cf233670f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]: iSNS:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]: STATIC:
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:11 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:11 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[36992b02-f393-4103-abce-1b75abf2fc9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c318f4ab-a3be-40b6-997e-d1f4a4507a2c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5e5e3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a435070-0483-4193-94bf-698b9647d929]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[340032a5-ea6d-4c4f-98d9-5cf037ef60e9]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57081704-7e48-4093-815b-fbdaea9bfe64]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b289831-aff2-4542-b8a9-3ed0a76bfeaf]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a12e3dc-b959-4b18-a836-13c7a835f54c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ee50b2-80eb-4d4d-b03e-9b49b0606787]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260]
Nov 14 08:05:11 user nova-compute[75305]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48f60536-b768-4936-82dd-2e41231e6f50 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7f1535-30b6-4e68-92fe-68171d57b9f3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== disconnect_volume: return (664ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.301s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awuhOCJX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:11 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a5967c-fd09-40d1-aa9b-bdd800cbf089]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]: iSNS:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]: STATIC:
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:11 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:11 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed2c58d-0925-40d1-b30a-430d0a70f008]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc07184-3380-4c63-9980-c5015b5df928]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5e5e3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e325c158-c839-415b-bd62-80049b7ad528]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e5217-b34e-482e-8ee3-cea088bd44b7]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da25dba9-b5b6-4f28-be8d-d731129b5b14]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[840275e4-35d5-4d05-bcae-af4799c7f9cf]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93552c5d-40cb-4743-8dbf-436799b9a498]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b8bd0e-081b-457c-ba05-2a70326f5050]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260]
Nov 14 08:05:11 user nova-compute[75305]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffccd15e-7e2d-4f3b-add1-f04394898248 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b4de1d-34fc-4b9d-b53d-fccfc9754161]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] <== disconnect_volume: return (581ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Deleting instance files /opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f_del
Nov 14 08:05:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Deletion of /opt/stack/data/nova/instances/6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f_del complete
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.284s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f08957-3865-4161-aefa-3f916ab11e42]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]: iSNS:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]: STATIC:
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:11 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:11 user nova-compute[75305]: No targets found.
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:11 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:11 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d1d07a-c31f-4bd3-a77a-0d4113290132]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: INFO nova.compute.manager [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Took 6.48 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8614bca0-87d6-449e-bf0c-f3ea6fde573f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe (non-flash)
Nov 14 08:05:11 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf44289090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe'): ({'sde'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Removing single pathed devices sde {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73000e8-6253-4576-99cd-70049129dd7b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfd9089-ed1f-4e43-9eb0-f43349a77447]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Flushing IO for device /dev/sde {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e673e8bb-1693-455b-be03-6094ec8bdc35]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df4a301-9ca4-448f-af0f-d39ddfa2931b]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16289cf8-d05a-46ca-895e-a66ec6679cac]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c368123a-a90e-40d5-b1c8-00e8a5aa4aae]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260]
Nov 14 08:05:12 user nova-compute[75305]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5677486-570c-4c75-b679-39a3d75036fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b857fa-e8c6-4a82-b61b-4b9144c40024]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] <== disconnect_volume: return (603ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Deleting instance files /opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2_del
Nov 14 08:05:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Deletion of /opt/stack/data/nova/instances/2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2_del complete
Nov 14 08:05:12 user nova-compute[75305]: INFO nova.compute.manager [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Took 5.59 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:12 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 is timed out.
Nov 14 08:05:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Successfully detached device vdb from instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 from the live domain config.
Nov 14 08:05:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DNevTfOo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:12 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRvXLfWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:12 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df909c4-b111-450f-abc1-88d2c0e2054b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:12 user nova-compute[75305]: No targets found.
Nov 14 08:05:12 user nova-compute[75305]: iSNS:
Nov 14 08:05:12 user nova-compute[75305]: No targets found.
Nov 14 08:05:12 user nova-compute[75305]: STATIC:
Nov 14 08:05:12 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:12 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:12 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:12 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6
Nov 14 08:05:12 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:12 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:12 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:12 user nova-compute[75305]: No targets found.
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:12 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:12 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f121787c-7676-45ea-a37a-c56ec4c1631a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a2fc4c-6ebe-4f4f-86f1-b60c2e996c86]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:12 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 (non-flash)
Nov 14 08:05:12 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542be200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6'): ({'sdk'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Removing single pathed devices sdk {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b6efac-6539-4513-8d5f-75cd5ea5ea40]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d372d26-0bee-48c2-bc07-2425d4fef6e0]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Flushing IO for device /dev/sdk {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4758d17-e39c-44b6-9eb3-0c2fadda0937]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.044s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3469a35e-079a-4dae-9568-adca596684fc]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] SCSI volumes sdk have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb2983f-fb18-4fe9-b07a-6ef709d5e0bb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.109s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1332cec5-46e3-4b5a-b6e4-89fc774c0d8b]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260]
Nov 14 08:05:12 user nova-compute[75305]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bdb17b-c188-425a-8527-4e25dd037bc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35dba66-4e98-4646-8dfb-9aaf803f082b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] <== disconnect_volume: return (371ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.371s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:12 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:12 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[048bd1b1-b5ca-445b-847b-f923089bec75]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:05:12 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd0ef6e-e301-4fdd-9448-8acf9d8f7fd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a] added
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9a3c29-ee7b-4924-bd4d-b76bcd04214e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e456ad12-27c4-49fc-ac0f-ed61013b0044]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRvXLfWB {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pRvXLfWB" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e83913-0299-44a1-bcea-f4d4b5e71df0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pRvXLfWB'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc6c619-1f55-4d19-81c5-6121a99e316b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59256cc-822b-4e0c-a41e-9848b39d373f]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be30852-5364-4cb3-9ba3-de835b129d44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260]
Nov 14 08:05:12 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9082b83f-1856-428e-bd1d-aeb811801adb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b89fc5-be1e-40d9-947b-3b34b14f0474]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a (non-flash)
Nov 14 08:05:12 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a (non-flash)
Nov 14 08:05:12 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb76d2d-bdf8-423e-80e6-099a5f94512a]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:05:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRvXLfWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG nova.objects.instance [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lazy-loading 'flavor' on Instance uuid 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8eb21ab7-b5f8-42a3-bc5e-96569fe8aeb6 tempest-VolumesAssistedSnapshotsTest-1013203436 tempest-VolumesAssistedSnapshotsTest-1013203436-project-admin] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== connect_volume: return (1742ms) {'type': 'block', 'scsi_wwn': '26266306335393336', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266306335393336', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.objects.instance [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'flavor' on Instance uuid 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:05:14 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:05:14 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:05:14 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:05:14 user nova-compute[75305]:   <serial>c28655e8-34c2-49a2-8334-4728348c6d4a</serial>
Nov 14 08:05:14 user nova-compute[75305]: </disk>
Nov 14 08:05:14 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-4014eaf5-fe77-4004-8769-3800c057d165 req-20130671-c852-461e-8872-fc4556bb77bd service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-deleted-7966bbc1-c5cf-4215-a0f0-39382b12dda7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:14 user nova-compute[75305]: INFO nova.compute.manager [req-4014eaf5-fe77-4004-8769-3800c057d165 req-20130671-c852-461e-8872-fc4556bb77bd service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Neutron deleted interface 7966bbc1-c5cf-4215-a0f0-39382b12dda7; detaching it from the instance and deleting it from the info cache
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-4014eaf5-fe77-4004-8769-3800c057d165 req-20130671-c852-461e-8872-fc4556bb77bd service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [{"id": "07ecf560-7926-48d7-a419-91293c5a8660", "address": "fa:16:3e:92:2e:24", "network": {"id": "a773e639-a8dc-426b-97f6-b6325f50e56f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2048695045-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap07ecf560-79", "ovs_interfaceid": "07ecf560-7926-48d7-a419-91293c5a8660", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "address": "fa:16:3e:94:0a:3d", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.71", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap848a7a02-af", "ovs_interfaceid": "848a7a02-afae-41f9-a7d6-59cd81ffb56f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "address": "fa:16:3e:9b:d7:29", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.210", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9b49c6d-81", "ovs_interfaceid": "b9b49c6d-8100-47af-8133-736ba3e1bde2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f93709c-024d-4406-bf37-8db387c5a6e8", "address": "fa:16:3e:df:95:ae", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.96", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f93709c-02", "ovs_interfaceid": "5f93709c-024d-4406-bf37-8db387c5a6e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a1142a-6df6-43cb-ab40-73583596e249", "address": "fa:16:3e:8b:29:78", "network": {"id": "20c248b6-3326-45a9-b48a-d77cf4921f96", "bridge": "br-int", "label": "tempest-device-tagging-net1-1684754450", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a1142a-6d", "ovs_interfaceid": "a4a1142a-6df6-43cb-ab40-73583596e249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "67ab3e90-3507-4776-883c-8bb583491e1c", "address": "fa:16:3e:22:bb:d2", "network": {"id": "ff32a521-cf53-4a63-b0d3-3bc63f935ec3", "bridge": "br-int", "label": "tempest-device-tagging-net2-1950389319", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "75bf7951de484ad6b5296e643847583a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67ab3e90-35", "ovs_interfaceid": "67ab3e90-3507-4776-883c-8bb583491e1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-f0943fbe-22f0-4644-8f5d-87cc2e5db8bc req-46da6d31-0003-4b42-9af8-636874a864fc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-deleted-a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:14 user nova-compute[75305]: INFO nova.compute.manager [req-f0943fbe-22f0-4644-8f5d-87cc2e5db8bc req-46da6d31-0003-4b42-9af8-636874a864fc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Neutron deleted interface a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8; detaching it from the instance and deleting it from the info cache
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-f0943fbe-22f0-4644-8f5d-87cc2e5db8bc req-46da6d31-0003-4b42-9af8-636874a864fc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [{"id": "70845bae-b029-4cfd-be13-cf8a87d11911", "address": "fa:16:3e:63:72:91", "network": {"id": "68640d53-8d65-494d-a493-34c5e4ade60b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-853185068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70845bae-b0", "ovs_interfaceid": "70845bae-b029-4cfd-be13-cf8a87d11911", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "address": "fa:16:3e:6f:70:00", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5d10339-70", "ovs_interfaceid": "e5d10339-70e7-42b6-9a02-9a4b4c59b845", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "address": "fa:16:3e:00:1e:0d", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b357b6e-c1", "ovs_interfaceid": "9b357b6e-c138-46c0-8fc3-5ab8d5e09709", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "address": "fa:16:3e:1f:8e:c6", "network": {"id": "d675d8fe-3620-4ae4-8833-5711a3105458", "bridge": "br-int", "label": "tempest-device-tagging-net1-754057006", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.233", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0b79350-e4", "ovs_interfaceid": "e0b79350-e4fb-4c5f-919e-f29efceb386b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb47e777-8726-47e9-ad11-70af908c61b0", "address": "fa:16:3e:65:43:8f", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb47e777-87", "ovs_interfaceid": "bb47e777-8726-47e9-ad11-70af908c61b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "address": "fa:16:3e:30:22:81", "network": {"id": "503f0ead-7f71-4961-8f19-058ea182d477", "bridge": "br-int", "label": "tempest-device-tagging-net2-1428357123", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e2fefab86d9b4003a2f1ea8035d28f3b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ee8e7e1-36", "ovs_interfaceid": "0ee8e7e1-3696-4af5-9402-187894a1fe99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-4014eaf5-fe77-4004-8769-3800c057d165 req-20130671-c852-461e-8872-fc4556bb77bd service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Detach interface failed, port_id=7966bbc1-c5cf-4215-a0f0-39382b12dda7, reason: Instance 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2 could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-f0943fbe-22f0-4644-8f5d-87cc2e5db8bc req-46da6d31-0003-4b42-9af8-636874a864fc service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Detach interface failed, port_id=a7afc5aa-6348-4ed2-9a39-ca4d9a6d4cc8, reason: Instance 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No VIF found with MAC fa:16:3e:60:7b:bf, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0a17e20d-eaf2-4291-8871-8a1f81da066d tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.423s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:15 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Took 3.94 seconds to deallocate network for instance.
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:16 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Took 3.86 seconds to deallocate network for instance.
Nov 14 08:05:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-5f6ae739-c41b-4bb1-807d-99becdaccc4c req-57ae0b95-f831-45de-8de3-44a00c11ce27 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-deleted-a4a1142a-6df6-43cb-ab40-73583596e249 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-5f6ae739-c41b-4bb1-807d-99becdaccc4c req-57ae0b95-f831-45de-8de3-44a00c11ce27 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-deleted-67ab3e90-3507-4776-883c-8bb583491e1c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-5f6ae739-c41b-4bb1-807d-99becdaccc4c req-57ae0b95-f831-45de-8de3-44a00c11ce27 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-deleted-07ecf560-7926-48d7-a419-91293c5a8660 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-5f6ae739-c41b-4bb1-807d-99becdaccc4c req-57ae0b95-f831-45de-8de3-44a00c11ce27 service nova] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Received event network-vif-deleted-5f93709c-024d-4406-bf37-8db387c5a6e8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-19bdd2e5-72a1-417e-b081-d91541b3c2b1 req-50afc070-23fb-466f-a9b6-8358c1851faa service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-deleted-bb47e777-8726-47e9-ad11-70af908c61b0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-19bdd2e5-72a1-417e-b081-d91541b3c2b1 req-50afc070-23fb-466f-a9b6-8358c1851faa service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-deleted-0ee8e7e1-3696-4af5-9402-187894a1fe99 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-19bdd2e5-72a1-417e-b081-d91541b3c2b1 req-50afc070-23fb-466f-a9b6-8358c1851faa service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-deleted-e0b79350-e4fb-4c5f-919e-f29efceb386b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-19bdd2e5-72a1-417e-b081-d91541b3c2b1 req-50afc070-23fb-466f-a9b6-8358c1851faa service nova] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Received event network-vif-deleted-70845bae-b029-4cfd-be13-cf8a87d11911 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:16 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:05:16 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:05:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7227MB free_disk=25.33333969116211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6dd11b5a-6147-4cd1-965a-19f75a091198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5959dc8-a417-4528-9f03-3951186c2315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 49ae6a17-49eb-4334-b517-1280009ae794 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:05:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:05:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:05:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:05:19 user nova-compute[75305]: INFO nova.compute.manager [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] [instance: 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f] Took 3.56 seconds to detach 3 volumes for instance.
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:19 user nova-compute[75305]: INFO nova.compute.manager [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] [instance: 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2] Took 3.61 seconds to detach 3 volumes for instance.
Nov 14 08:05:19 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.055s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:19 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Deleted allocations for instance 6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f
Nov 14 08:05:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19ec0617-fa5e-44e6-bb60-eb03db57051e tempest-TaggedBootDevicesTest_v242-1568364879 tempest-TaggedBootDevicesTest_v242-1568364879-project-member] Lock "6fd8da5c-8eb9-4eac-a26e-e8b2a55b014f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.531s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:20 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:20 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:20 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Deleted allocations for instance 2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2
Nov 14 08:05:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-07ef0397-4274-43b2-9fe9-47e6e4acd717 tempest-TaggedBootDevicesTest-1271835931 tempest-TaggedBootDevicesTest-1271835931-project-member] Lock "2a3e0b9b-74e5-40fd-bc28-f8bfaba82be2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.734s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:22 user nova-compute[75305]: INFO nova.compute.manager [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Detaching volume c28655e8-34c2-49a2-8334-4728348c6d4a
Nov 14 08:05:22 user nova-compute[75305]: INFO nova.virt.block_device [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Attempting to driver detach volume c28655e8-34c2-49a2-8334-4728348c6d4a from mountpoint /dev/vdb
Nov 14 08:05:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Attempting to detach device vdb from instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:05:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:05:22 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:05:22 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:05:22 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:05:22 user nova-compute[75305]:   <serial>c28655e8-34c2-49a2-8334-4728348c6d4a</serial>
Nov 14 08:05:22 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:05:22 user nova-compute[75305]: </disk>
Nov 14 08:05:22 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:05:22 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully detached device vdb from instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a from the persistent domain config.
Nov 14 08:05:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:05:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:05:22 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:05:22 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:05:22 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:05:22 user nova-compute[75305]:   <serial>c28655e8-34c2-49a2-8334-4728348c6d4a</serial>
Nov 14 08:05:22 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:05:22 user nova-compute[75305]: </disk>
Nov 14 08:05:22 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:05:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:05:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Waiting for libvirt event about the detach of device tap252d2d44-8c with device alias net1 from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 is timed out.
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface> {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 08:05:25 user nova-compute[75305]:   <name>instance-00000007</name>
Nov 14 08:05:25 user nova-compute[75305]:   <uuid>186a5286-ecc4-43e6-aea3-2529ddd72b58</uuid>
Nov 14 08:05:25 user nova-compute[75305]:   <metadata>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:05:25 user nova-compute[75305]:   <nova:package version="0.0.0"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:creationTime>2023-11-14 08:04:33</nova:creationTime>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:flavor name="m1.tiny">
Nov 14 08:05:25 user nova-compute[75305]:     <nova:memory>512</nova:memory>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:disk>1</nova:disk>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:swap>0</nova:swap>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:vcpus>1</nova:vcpus>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:flavor>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:ports>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:05:25 user nova-compute[75305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:05:25 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:port uuid="252d2d44-8c0d-4941-b436-9894773fc7ab">
Nov 14 08:05:25 user nova-compute[75305]:       <nova:ip type="fixed" address="10.10.10.168" ipVersion="4"/>
Nov 14 08:05:25 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:ports>
Nov 14 08:05:25 user nova-compute[75305]: </nova:instance>
Nov 14 08:05:25 user nova-compute[75305]:   </metadata>
Nov 14 08:05:25 user nova-compute[75305]:   <memory unit='KiB'>524288</memory>
Nov 14 08:05:25 user nova-compute[75305]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 08:05:25 user nova-compute[75305]:   <vcpu placement='static'>1</vcpu>
Nov 14 08:05:25 user nova-compute[75305]:   <resource>
Nov 14 08:05:25 user nova-compute[75305]:     <partition>/machine</partition>
Nov 14 08:05:25 user nova-compute[75305]:   </resource>
Nov 14 08:05:25 user nova-compute[75305]:   <sysinfo type='smbios'>
Nov 14 08:05:25 user nova-compute[75305]:     <system>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='version'>0.0.0</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='serial'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='uuid'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='family'>Virtual Machine</entry>
Nov 14 08:05:25 user nova-compute[75305]:     </system>
Nov 14 08:05:25 user nova-compute[75305]:   </sysinfo>
Nov 14 08:05:25 user nova-compute[75305]:   <os>
Nov 14 08:05:25 user nova-compute[75305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 08:05:25 user nova-compute[75305]:     <boot dev='hd'/>
Nov 14 08:05:25 user nova-compute[75305]:     <smbios mode='sysinfo'/>
Nov 14 08:05:25 user nova-compute[75305]:   </os>
Nov 14 08:05:25 user nova-compute[75305]:   <features>
Nov 14 08:05:25 user nova-compute[75305]:     <acpi/>
Nov 14 08:05:25 user nova-compute[75305]:     <apic/>
Nov 14 08:05:25 user nova-compute[75305]:     <vmcoreinfo state='on'/>
Nov 14 08:05:25 user nova-compute[75305]:   </features>
Nov 14 08:05:25 user nova-compute[75305]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 08:05:25 user nova-compute[75305]:     <model fallback='forbid'>Nehalem</model>
Nov 14 08:05:25 user nova-compute[75305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='vme'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='x2apic'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='hypervisor'/>
Nov 14 08:05:25 user nova-compute[75305]:   </cpu>
Nov 14 08:05:25 user nova-compute[75305]:   <clock offset='utc'>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='hpet' present='no'/>
Nov 14 08:05:25 user nova-compute[75305]:   </clock>
Nov 14 08:05:25 user nova-compute[75305]:   <on_poweroff>destroy</on_poweroff>
Nov 14 08:05:25 user nova-compute[75305]:   <on_reboot>restart</on_reboot>
Nov 14 08:05:25 user nova-compute[75305]:   <on_crash>destroy</on_crash>
Nov 14 08:05:25 user nova-compute[75305]:   <devices>
Nov 14 08:05:25 user nova-compute[75305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 08:05:25 user nova-compute[75305]:     <disk type='file' device='disk'>
Nov 14 08:05:25 user nova-compute[75305]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 08:05:25 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk' index='2'/>
Nov 14 08:05:25 user nova-compute[75305]:       <backingStore type='file' index='3'>
Nov 14 08:05:25 user nova-compute[75305]:         <format type='raw'/>
Nov 14 08:05:25 user nova-compute[75305]:         <source file='/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48'/>
Nov 14 08:05:25 user nova-compute[75305]:         <backingStore/>
Nov 14 08:05:25 user nova-compute[75305]:       </backingStore>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='vda' bus='virtio'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='virtio-disk0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </disk>
Nov 14 08:05:25 user nova-compute[75305]:     <disk type='file' device='cdrom'>
Nov 14 08:05:25 user nova-compute[75305]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 08:05:25 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config' index='1'/>
Nov 14 08:05:25 user nova-compute[75305]:       <backingStore/>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='hda' bus='ide'/>
Nov 14 08:05:25 user nova-compute[75305]:       <readonly/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='ide0-0-0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </disk>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='usb' index='0' model='none'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='usb'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='pci.0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='ide' index='0'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='ide'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <interface type='ethernet'>
Nov 14 08:05:25 user nova-compute[75305]:       <mac address='fa:16:3e:74:b6:cb'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='tap88edc6a5-97'/>
Nov 14 08:05:25 user nova-compute[75305]:       <model type='virtio'/>
Nov 14 08:05:25 user nova-compute[75305]:       <mtu size='1442'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='net0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </interface>
Nov 14 08:05:25 user nova-compute[75305]:     <serial type='pty'>
Nov 14 08:05:25 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:25 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target type='isa-serial' port='0'>
Nov 14 08:05:25 user nova-compute[75305]:         <model name='isa-serial'/>
Nov 14 08:05:25 user nova-compute[75305]:       </target>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </serial>
Nov 14 08:05:25 user nova-compute[75305]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 08:05:25 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:25 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target type='serial' port='0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </console>
Nov 14 08:05:25 user nova-compute[75305]:     <input type='mouse' bus='ps2'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='input0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </input>
Nov 14 08:05:25 user nova-compute[75305]:     <input type='keyboard' bus='ps2'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='input1'/>
Nov 14 08:05:25 user nova-compute[75305]:     </input>
Nov 14 08:05:25 user nova-compute[75305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 08:05:25 user nova-compute[75305]:       <listen type='address' address='0.0.0.0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </graphics>
Nov 14 08:05:25 user nova-compute[75305]:     <audio id='1' type='none'/>
Nov 14 08:05:25 user nova-compute[75305]:     <video>
Nov 14 08:05:25 user nova-compute[75305]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='video0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </video>
Nov 14 08:05:25 user nova-compute[75305]:     <memballoon model='virtio'>
Nov 14 08:05:25 user nova-compute[75305]:       <stats period='10'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='balloon0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </memballoon>
Nov 14 08:05:25 user nova-compute[75305]:     <rng model='virtio'>
Nov 14 08:05:25 user nova-compute[75305]:       <backend model='random'>/dev/urandom</backend>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='rng0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </rng>
Nov 14 08:05:25 user nova-compute[75305]:   </devices>
Nov 14 08:05:25 user nova-compute[75305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 08:05:25 user nova-compute[75305]:     <label>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</label>
Nov 14 08:05:25 user nova-compute[75305]:     <imagelabel>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</imagelabel>
Nov 14 08:05:25 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:25 user nova-compute[75305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 08:05:25 user nova-compute[75305]:     <label>+64055:+108</label>
Nov 14 08:05:25 user nova-compute[75305]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 08:05:25 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:25 user nova-compute[75305]: </domain>
Nov 14 08:05:25 user nova-compute[75305]:  {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 08:05:25 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully detached device tap252d2d44-8c from instance 186a5286-ecc4-43e6-aea3-2529ddd72b58 from the live domain config.
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converting VIF {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG os_vif [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap252d2d44-8c, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0dbd513-6aeb-4cb1-904f-287890928657) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:25 user nova-compute[75305]: INFO os_vif [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c')
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:05:25 user nova-compute[75305]:   <nova:package version="0.0.0"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:creationTime>2023-11-14 08:05:25</nova:creationTime>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:flavor name="m1.tiny">
Nov 14 08:05:25 user nova-compute[75305]:     <nova:memory>512</nova:memory>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:disk>1</nova:disk>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:swap>0</nova:swap>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:vcpus>1</nova:vcpus>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:flavor>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:ports>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:05:25 user nova-compute[75305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:05:25 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:ports>
Nov 14 08:05:25 user nova-compute[75305]: </nova:instance>
Nov 14 08:05:25 user nova-compute[75305]:  {{(pid=75305) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-deleted-252d2d44-8c0d-4941-b436-9894773fc7ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:25 user nova-compute[75305]: INFO nova.compute.manager [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Neutron deleted interface 252d2d44-8c0d-4941-b436-9894773fc7ab; detaching it from the instance and deleting it from the info cache
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.objects.instance [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Lazy-loading 'system_metadata' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquired lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.objects.instance [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Lazy-loading 'flavor' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.objects.base [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Object Instance<186a5286-ecc4-43e6-aea3-2529ddd72b58> lazy-loaded attributes: system_metadata,flavor {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Converting VIF {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface> {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 08:05:25 user nova-compute[75305]:   <name>instance-00000007</name>
Nov 14 08:05:25 user nova-compute[75305]:   <uuid>186a5286-ecc4-43e6-aea3-2529ddd72b58</uuid>
Nov 14 08:05:25 user nova-compute[75305]:   <metadata>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:05:25 user nova-compute[75305]:   <nova:package version="0.0.0"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:creationTime>2023-11-14 08:05:25</nova:creationTime>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:flavor name="m1.tiny">
Nov 14 08:05:25 user nova-compute[75305]:     <nova:memory>512</nova:memory>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:disk>1</nova:disk>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:swap>0</nova:swap>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:vcpus>1</nova:vcpus>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:flavor>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:ports>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:05:25 user nova-compute[75305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:05:25 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:ports>
Nov 14 08:05:25 user nova-compute[75305]: </nova:instance>
Nov 14 08:05:25 user nova-compute[75305]:   </metadata>
Nov 14 08:05:25 user nova-compute[75305]:   <memory unit='KiB'>524288</memory>
Nov 14 08:05:25 user nova-compute[75305]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 08:05:25 user nova-compute[75305]:   <vcpu placement='static'>1</vcpu>
Nov 14 08:05:25 user nova-compute[75305]:   <resource>
Nov 14 08:05:25 user nova-compute[75305]:     <partition>/machine</partition>
Nov 14 08:05:25 user nova-compute[75305]:   </resource>
Nov 14 08:05:25 user nova-compute[75305]:   <sysinfo type='smbios'>
Nov 14 08:05:25 user nova-compute[75305]:     <system>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='version'>0.0.0</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='serial'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='uuid'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='family'>Virtual Machine</entry>
Nov 14 08:05:25 user nova-compute[75305]:     </system>
Nov 14 08:05:25 user nova-compute[75305]:   </sysinfo>
Nov 14 08:05:25 user nova-compute[75305]:   <os>
Nov 14 08:05:25 user nova-compute[75305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 08:05:25 user nova-compute[75305]:     <boot dev='hd'/>
Nov 14 08:05:25 user nova-compute[75305]:     <smbios mode='sysinfo'/>
Nov 14 08:05:25 user nova-compute[75305]:   </os>
Nov 14 08:05:25 user nova-compute[75305]:   <features>
Nov 14 08:05:25 user nova-compute[75305]:     <acpi/>
Nov 14 08:05:25 user nova-compute[75305]:     <apic/>
Nov 14 08:05:25 user nova-compute[75305]:     <vmcoreinfo state='on'/>
Nov 14 08:05:25 user nova-compute[75305]:   </features>
Nov 14 08:05:25 user nova-compute[75305]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 08:05:25 user nova-compute[75305]:     <model fallback='forbid'>Nehalem</model>
Nov 14 08:05:25 user nova-compute[75305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='vme'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='x2apic'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='hypervisor'/>
Nov 14 08:05:25 user nova-compute[75305]:   </cpu>
Nov 14 08:05:25 user nova-compute[75305]:   <clock offset='utc'>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='hpet' present='no'/>
Nov 14 08:05:25 user nova-compute[75305]:   </clock>
Nov 14 08:05:25 user nova-compute[75305]:   <on_poweroff>destroy</on_poweroff>
Nov 14 08:05:25 user nova-compute[75305]:   <on_reboot>restart</on_reboot>
Nov 14 08:05:25 user nova-compute[75305]:   <on_crash>destroy</on_crash>
Nov 14 08:05:25 user nova-compute[75305]:   <devices>
Nov 14 08:05:25 user nova-compute[75305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 08:05:25 user nova-compute[75305]:     <disk type='file' device='disk'>
Nov 14 08:05:25 user nova-compute[75305]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 08:05:25 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk' index='2'/>
Nov 14 08:05:25 user nova-compute[75305]:       <backingStore type='file' index='3'>
Nov 14 08:05:25 user nova-compute[75305]:         <format type='raw'/>
Nov 14 08:05:25 user nova-compute[75305]:         <source file='/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48'/>
Nov 14 08:05:25 user nova-compute[75305]:         <backingStore/>
Nov 14 08:05:25 user nova-compute[75305]:       </backingStore>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='vda' bus='virtio'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='virtio-disk0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </disk>
Nov 14 08:05:25 user nova-compute[75305]:     <disk type='file' device='cdrom'>
Nov 14 08:05:25 user nova-compute[75305]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 08:05:25 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config' index='1'/>
Nov 14 08:05:25 user nova-compute[75305]:       <backingStore/>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='hda' bus='ide'/>
Nov 14 08:05:25 user nova-compute[75305]:       <readonly/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='ide0-0-0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </disk>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='usb' index='0' model='none'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='usb'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='pci.0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='ide' index='0'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='ide'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <interface type='ethernet'>
Nov 14 08:05:25 user nova-compute[75305]:       <mac address='fa:16:3e:74:b6:cb'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='tap88edc6a5-97'/>
Nov 14 08:05:25 user nova-compute[75305]:       <model type='virtio'/>
Nov 14 08:05:25 user nova-compute[75305]:       <mtu size='1442'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='net0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </interface>
Nov 14 08:05:25 user nova-compute[75305]:     <serial type='pty'>
Nov 14 08:05:25 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:25 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target type='isa-serial' port='0'>
Nov 14 08:05:25 user nova-compute[75305]:         <model name='isa-serial'/>
Nov 14 08:05:25 user nova-compute[75305]:       </target>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </serial>
Nov 14 08:05:25 user nova-compute[75305]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 08:05:25 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:25 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target type='serial' port='0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </console>
Nov 14 08:05:25 user nova-compute[75305]:     <input type='mouse' bus='ps2'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='input0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </input>
Nov 14 08:05:25 user nova-compute[75305]:     <input type='keyboard' bus='ps2'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='input1'/>
Nov 14 08:05:25 user nova-compute[75305]:     </input>
Nov 14 08:05:25 user nova-compute[75305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 08:05:25 user nova-compute[75305]:       <listen type='address' address='0.0.0.0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </graphics>
Nov 14 08:05:25 user nova-compute[75305]:     <audio id='1' type='none'/>
Nov 14 08:05:25 user nova-compute[75305]:     <video>
Nov 14 08:05:25 user nova-compute[75305]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='video0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </video>
Nov 14 08:05:25 user nova-compute[75305]:     <memballoon model='virtio'>
Nov 14 08:05:25 user nova-compute[75305]:       <stats period='10'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='balloon0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </memballoon>
Nov 14 08:05:25 user nova-compute[75305]:     <rng model='virtio'>
Nov 14 08:05:25 user nova-compute[75305]:       <backend model='random'>/dev/urandom</backend>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='rng0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </rng>
Nov 14 08:05:25 user nova-compute[75305]:   </devices>
Nov 14 08:05:25 user nova-compute[75305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 08:05:25 user nova-compute[75305]:     <label>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</label>
Nov 14 08:05:25 user nova-compute[75305]:     <imagelabel>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</imagelabel>
Nov 14 08:05:25 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:25 user nova-compute[75305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 08:05:25 user nova-compute[75305]:     <label>+64055:+108</label>
Nov 14 08:05:25 user nova-compute[75305]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 08:05:25 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:25 user nova-compute[75305]: </domain>
Nov 14 08:05:25 user nova-compute[75305]:  {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface> {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:05:13:0e"/><model type="virtio"/><mtu size="1442"/><target dev="tap252d2d44-8c"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 08:05:25 user nova-compute[75305]:   <name>instance-00000007</name>
Nov 14 08:05:25 user nova-compute[75305]:   <uuid>186a5286-ecc4-43e6-aea3-2529ddd72b58</uuid>
Nov 14 08:05:25 user nova-compute[75305]:   <metadata>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:05:25 user nova-compute[75305]:   <nova:package version="0.0.0"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:creationTime>2023-11-14 08:05:25</nova:creationTime>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:flavor name="m1.tiny">
Nov 14 08:05:25 user nova-compute[75305]:     <nova:memory>512</nova:memory>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:disk>1</nova:disk>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:swap>0</nova:swap>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:vcpus>1</nova:vcpus>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:flavor>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:ports>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:05:25 user nova-compute[75305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:05:25 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:ports>
Nov 14 08:05:25 user nova-compute[75305]: </nova:instance>
Nov 14 08:05:25 user nova-compute[75305]:   </metadata>
Nov 14 08:05:25 user nova-compute[75305]:   <memory unit='KiB'>524288</memory>
Nov 14 08:05:25 user nova-compute[75305]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 08:05:25 user nova-compute[75305]:   <vcpu placement='static'>1</vcpu>
Nov 14 08:05:25 user nova-compute[75305]:   <resource>
Nov 14 08:05:25 user nova-compute[75305]:     <partition>/machine</partition>
Nov 14 08:05:25 user nova-compute[75305]:   </resource>
Nov 14 08:05:25 user nova-compute[75305]:   <sysinfo type='smbios'>
Nov 14 08:05:25 user nova-compute[75305]:     <system>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='version'>0.0.0</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='serial'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='uuid'>186a5286-ecc4-43e6-aea3-2529ddd72b58</entry>
Nov 14 08:05:25 user nova-compute[75305]:       <entry name='family'>Virtual Machine</entry>
Nov 14 08:05:25 user nova-compute[75305]:     </system>
Nov 14 08:05:25 user nova-compute[75305]:   </sysinfo>
Nov 14 08:05:25 user nova-compute[75305]:   <os>
Nov 14 08:05:25 user nova-compute[75305]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 08:05:25 user nova-compute[75305]:     <boot dev='hd'/>
Nov 14 08:05:25 user nova-compute[75305]:     <smbios mode='sysinfo'/>
Nov 14 08:05:25 user nova-compute[75305]:   </os>
Nov 14 08:05:25 user nova-compute[75305]:   <features>
Nov 14 08:05:25 user nova-compute[75305]:     <acpi/>
Nov 14 08:05:25 user nova-compute[75305]:     <apic/>
Nov 14 08:05:25 user nova-compute[75305]:     <vmcoreinfo state='on'/>
Nov 14 08:05:25 user nova-compute[75305]:   </features>
Nov 14 08:05:25 user nova-compute[75305]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 08:05:25 user nova-compute[75305]:     <model fallback='forbid'>Nehalem</model>
Nov 14 08:05:25 user nova-compute[75305]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='vme'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='x2apic'/>
Nov 14 08:05:25 user nova-compute[75305]:     <feature policy='require' name='hypervisor'/>
Nov 14 08:05:25 user nova-compute[75305]:   </cpu>
Nov 14 08:05:25 user nova-compute[75305]:   <clock offset='utc'>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 08:05:25 user nova-compute[75305]:     <timer name='hpet' present='no'/>
Nov 14 08:05:25 user nova-compute[75305]:   </clock>
Nov 14 08:05:25 user nova-compute[75305]:   <on_poweroff>destroy</on_poweroff>
Nov 14 08:05:25 user nova-compute[75305]:   <on_reboot>restart</on_reboot>
Nov 14 08:05:25 user nova-compute[75305]:   <on_crash>destroy</on_crash>
Nov 14 08:05:25 user nova-compute[75305]:   <devices>
Nov 14 08:05:25 user nova-compute[75305]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 08:05:25 user nova-compute[75305]:     <disk type='file' device='disk'>
Nov 14 08:05:25 user nova-compute[75305]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 08:05:25 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk' index='2'/>
Nov 14 08:05:25 user nova-compute[75305]:       <backingStore type='file' index='3'>
Nov 14 08:05:25 user nova-compute[75305]:         <format type='raw'/>
Nov 14 08:05:25 user nova-compute[75305]:         <source file='/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48'/>
Nov 14 08:05:25 user nova-compute[75305]:         <backingStore/>
Nov 14 08:05:25 user nova-compute[75305]:       </backingStore>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='vda' bus='virtio'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='virtio-disk0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </disk>
Nov 14 08:05:25 user nova-compute[75305]:     <disk type='file' device='cdrom'>
Nov 14 08:05:25 user nova-compute[75305]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 08:05:25 user nova-compute[75305]:       <source file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/disk.config' index='1'/>
Nov 14 08:05:25 user nova-compute[75305]:       <backingStore/>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='hda' bus='ide'/>
Nov 14 08:05:25 user nova-compute[75305]:       <readonly/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='ide0-0-0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </disk>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='usb' index='0' model='none'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='usb'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='pci.0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <controller type='ide' index='0'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='ide'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 08:05:25 user nova-compute[75305]:     </controller>
Nov 14 08:05:25 user nova-compute[75305]:     <interface type='ethernet'>
Nov 14 08:05:25 user nova-compute[75305]:       <mac address='fa:16:3e:74:b6:cb'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target dev='tap88edc6a5-97'/>
Nov 14 08:05:25 user nova-compute[75305]:       <model type='virtio'/>
Nov 14 08:05:25 user nova-compute[75305]:       <mtu size='1442'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='net0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </interface>
Nov 14 08:05:25 user nova-compute[75305]:     <serial type='pty'>
Nov 14 08:05:25 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:25 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target type='isa-serial' port='0'>
Nov 14 08:05:25 user nova-compute[75305]:         <model name='isa-serial'/>
Nov 14 08:05:25 user nova-compute[75305]:       </target>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </serial>
Nov 14 08:05:25 user nova-compute[75305]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 08:05:25 user nova-compute[75305]:       <source path='/dev/pts/6'/>
Nov 14 08:05:25 user nova-compute[75305]:       <log file='/opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58/console.log' append='off'/>
Nov 14 08:05:25 user nova-compute[75305]:       <target type='serial' port='0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='serial0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </console>
Nov 14 08:05:25 user nova-compute[75305]:     <input type='mouse' bus='ps2'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='input0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </input>
Nov 14 08:05:25 user nova-compute[75305]:     <input type='keyboard' bus='ps2'>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='input1'/>
Nov 14 08:05:25 user nova-compute[75305]:     </input>
Nov 14 08:05:25 user nova-compute[75305]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 08:05:25 user nova-compute[75305]:       <listen type='address' address='0.0.0.0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </graphics>
Nov 14 08:05:25 user nova-compute[75305]:     <audio id='1' type='none'/>
Nov 14 08:05:25 user nova-compute[75305]:     <video>
Nov 14 08:05:25 user nova-compute[75305]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='video0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </video>
Nov 14 08:05:25 user nova-compute[75305]:     <memballoon model='virtio'>
Nov 14 08:05:25 user nova-compute[75305]:       <stats period='10'/>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='balloon0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </memballoon>
Nov 14 08:05:25 user nova-compute[75305]:     <rng model='virtio'>
Nov 14 08:05:25 user nova-compute[75305]:       <backend model='random'>/dev/urandom</backend>
Nov 14 08:05:25 user nova-compute[75305]:       <alias name='rng0'/>
Nov 14 08:05:25 user nova-compute[75305]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 08:05:25 user nova-compute[75305]:     </rng>
Nov 14 08:05:25 user nova-compute[75305]:   </devices>
Nov 14 08:05:25 user nova-compute[75305]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 08:05:25 user nova-compute[75305]:     <label>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</label>
Nov 14 08:05:25 user nova-compute[75305]:     <imagelabel>libvirt-186a5286-ecc4-43e6-aea3-2529ddd72b58</imagelabel>
Nov 14 08:05:25 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:25 user nova-compute[75305]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 08:05:25 user nova-compute[75305]:     <label>+64055:+108</label>
Nov 14 08:05:25 user nova-compute[75305]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 08:05:25 user nova-compute[75305]:   </seclabel>
Nov 14 08:05:25 user nova-compute[75305]: </domain>
Nov 14 08:05:25 user nova-compute[75305]:  {{(pid=75305) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 08:05:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Detaching interface fa:16:3e:05:13:0e failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap252d2d44-8c' not found.
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Converting VIF {"id": "252d2d44-8c0d-4941-b436-9894773fc7ab", "address": "fa:16:3e:05:13:0e", "network": {"id": "95543dab-8234-462f-8d8a-26a963aa6223", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-385153055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap252d2d44-8c", "ovs_interfaceid": "252d2d44-8c0d-4941-b436-9894773fc7ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG os_vif [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap252d2d44-8c, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:05:25 user nova-compute[75305]: INFO os_vif [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:13:0e,bridge_name='br-int',has_traffic_filtering=True,id=252d2d44-8c0d-4941-b436-9894773fc7ab,network=Network(95543dab-8234-462f-8d8a-26a963aa6223),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap252d2d44-8c')
Nov 14 08:05:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [req-0fa1ac32-e338-40c8-8a09-8a2e153c2d5c req-6b8426d8-98e6-47e4-8389-e63dab102ce8 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:05:25 user nova-compute[75305]:   <nova:package version="0.0.0"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:name>tempest-device-tagging-server-1209143005</nova:name>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:creationTime>2023-11-14 08:05:25</nova:creationTime>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:flavor name="m1.tiny">
Nov 14 08:05:25 user nova-compute[75305]:     <nova:memory>512</nova:memory>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:disk>1</nova:disk>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:swap>0</nova:swap>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:vcpus>1</nova:vcpus>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:flavor>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:user uuid="8c90e99f86334376bdbfd4b76263fd15">tempest-TaggedAttachmentsTest-745059634-project-member</nova:user>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:project uuid="ed60def7f2d441fcb3147dc96fdce086">tempest-TaggedAttachmentsTest-745059634</nova:project>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:owner>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:05:25 user nova-compute[75305]:   <nova:ports>
Nov 14 08:05:25 user nova-compute[75305]:     <nova:port uuid="88edc6a5-9716-411e-8ea6-9da3cac488d0">
Nov 14 08:05:25 user nova-compute[75305]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:05:25 user nova-compute[75305]:     </nova:port>
Nov 14 08:05:25 user nova-compute[75305]:   </nova:ports>
Nov 14 08:05:25 user nova-compute[75305]: </nova:instance>
Nov 14 08:05:25 user nova-compute[75305]:  {{(pid=75305) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 08:05:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [{"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Releasing lock "refresh_cache-186a5286-ecc4-43e6-aea3-2529ddd72b58" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:05:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-55bc26d2-99e5-4b6f-b024-1037398e55b6 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "interface-186a5286-ecc4-43e6-aea3-2529ddd72b58-252d2d44-8c0d-4941-b436-9894773fc7ab" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.402s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:05:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:05:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:05:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:42 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a is timed out.
Nov 14 08:05:42 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully detached device vdb from instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a from the live domain config.
Nov 14 08:05:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRvXLfWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:42 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7365261b-b8db-4675-9a4f-75b7fe400125]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:42 user nova-compute[75305]: No targets found.
Nov 14 08:05:42 user nova-compute[75305]: iSNS:
Nov 14 08:05:42 user nova-compute[75305]: No targets found.
Nov 14 08:05:42 user nova-compute[75305]: STATIC:
Nov 14 08:05:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a
Nov 14 08:05:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:42 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:42 user nova-compute[75305]: No targets found.
Nov 14 08:05:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:42 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:42 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b1108-2fbe-4429-a637-1122db363d00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec460c-e268-43a8-a551-f715a661a46f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a (non-flash)
Nov 14 08:05:42 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a (non-flash)
Nov 14 08:05:42 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442c3c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef2b180-dd12-48ad-aa96-cde650ea73ac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[482121ee-b174-4951-bfbe-ed0f76c20f93]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[253718d2-8670-4afa-a1da-8c113514b9a4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1066fd-502d-4b64-bb53-80dae187a355]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7410cc07-fc0f-47b7-b450-09b865c033c1]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b95f2-b124-4da4-8764-c8137324640d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260]
Nov 14 08:05:43 user nova-compute[75305]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a, portal: 172.16.0.220,3260] successful.
Nov 14 08:05:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[055423de-f78d-4426-9b46-ccdf14f45cea]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== disconnect_volume: return (277ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'flavor' on Instance uuid 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c836b640-ec2e-4b12-bbd0-f21d4d057ebc tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.681s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.569s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:43 user nova-compute[75305]: INFO nova.compute.manager [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Terminating instance
Nov 14 08:05:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-724ac7bb-a246-4e3d-bb33-55bbafdaeb0a req-615bfc33-1e79-492f-bb82-277ffea90cdb service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-vif-unplugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-724ac7bb-a246-4e3d-bb33-55bbafdaeb0a req-615bfc33-1e79-492f-bb82-277ffea90cdb service nova] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-724ac7bb-a246-4e3d-bb33-55bbafdaeb0a req-615bfc33-1e79-492f-bb82-277ffea90cdb service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-724ac7bb-a246-4e3d-bb33-55bbafdaeb0a req-615bfc33-1e79-492f-bb82-277ffea90cdb service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-724ac7bb-a246-4e3d-bb33-55bbafdaeb0a req-615bfc33-1e79-492f-bb82-277ffea90cdb service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] No waiting events found dispatching network-vif-unplugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-724ac7bb-a246-4e3d-bb33-55bbafdaeb0a req-615bfc33-1e79-492f-bb82-277ffea90cdb service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-vif-unplugged-43bdf938-f392-40d2-9a72-46930577a7f0 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:44 user nova-compute[75305]: INFO nova.compute.manager [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Terminating instance
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-91af7086-38ae-4fcd-af10-8ee5f0bcc51c req-21af1a0d-02e2-4df8-b1c3-7043cd203198 service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-vif-unplugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-91af7086-38ae-4fcd-af10-8ee5f0bcc51c req-21af1a0d-02e2-4df8-b1c3-7043cd203198 service nova] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-91af7086-38ae-4fcd-af10-8ee5f0bcc51c req-21af1a0d-02e2-4df8-b1c3-7043cd203198 service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-91af7086-38ae-4fcd-af10-8ee5f0bcc51c req-21af1a0d-02e2-4df8-b1c3-7043cd203198 service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-91af7086-38ae-4fcd-af10-8ee5f0bcc51c req-21af1a0d-02e2-4df8-b1c3-7043cd203198 service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] No waiting events found dispatching network-vif-unplugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-91af7086-38ae-4fcd-af10-8ee5f0bcc51c req-21af1a0d-02e2-4df8-b1c3-7043cd203198 service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-vif-unplugged-ef83a02a-32fc-4d4b-8801-55bccce74380 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Instance destroyed successfully.
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'resources' on Instance uuid 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:03:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2131009544',display_name='tempest-VolumesSnapshotTestJSON-instance-2131009544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2131009544',id=11,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKvV/jmqbK9vGERUBpcAKZXhjXryjZkO7DQWX6Zlu8Xtu/icfWXJ+BZmTP/nfBcsM+trGu7m1Lo7M4yStjjHxTdEd6ZGNI1z6JBoigcnDlOraoV22jeJ6SCs+vNzZaZW3w==',key_name='tempest-keypair-1091663583',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45dc68f3d5354a06905843816164c441',ramdisk_id='',reservation_id='r-bh5nrg88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-109737474',owner_user_name='tempest-VolumesSnapshotTestJSON-109737474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c331473d0aef488fa1dd92543749f50e',uuid=91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converting VIF {"id": "43bdf938-f392-40d2-9a72-46930577a7f0", "address": "fa:16:3e:60:7b:bf", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43bdf938-f3", "ovs_interfaceid": "43bdf938-f392-40d2-9a72-46930577a7f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=43bdf938-f392-40d2-9a72-46930577a7f0,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bdf938-f3') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_vif [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=43bdf938-f392-40d2-9a72-46930577a7f0,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bdf938-f3') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43bdf938-f3, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44fd2cdd-0e20-4e9d-936d-bb48e42cde4d) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:44 user nova-compute[75305]: INFO os_vif [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7b:bf,bridge_name='br-int',has_traffic_filtering=True,id=43bdf938-f392-40d2-9a72-46930577a7f0,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43bdf938-f3')
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pRvXLfWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:05:44 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90f27c2-8442-4862-8bf3-41dd15d0a3f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:05:44 user nova-compute[75305]: No targets found.
Nov 14 08:05:44 user nova-compute[75305]: iSNS:
Nov 14 08:05:44 user nova-compute[75305]: No targets found.
Nov 14 08:05:44 user nova-compute[75305]: STATIC:
Nov 14 08:05:44 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:05:44 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:05:44 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:05:44 user nova-compute[75305]: FIRMWARE:
Nov 14 08:05:44 user nova-compute[75305]: No targets found.
Nov 14 08:05:44 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:05:44 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:05:44 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c28655e8-34c2-49a2-8334-4728348c6d4a', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d667db-7d10-4bac-9a4a-37b1e6a08b5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2b8ecd-5744-493b-a016-95fcca2fceb7]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:44 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:05:44 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442c4040>, {}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Disconnecting from: [] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== disconnect_volume: return (72ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:05:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Deleting instance files /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a_del
Nov 14 08:05:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Deletion of /opt/stack/data/nova/instances/91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a_del complete
Nov 14 08:05:44 user nova-compute[75305]: INFO nova.compute.manager [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:44 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:44 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Instance destroyed successfully.
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.objects.instance [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lazy-loading 'resources' on Instance uuid 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-17695839',display_name='tempest-VolumesAssistedSnapshotsTest-server-17695839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-17695839',id=8,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6FpuGby8ca+THnEsjeTqhPHi/DyjrNVcJHxnJVs68tO8VNaKi4OGn2xeFF3teiZ/2lw082QMXd/2eQRzEZcu1ceihR/o81JP8ylKE9v1qJIE6p5R96oyf5D4mvh6Bgsg==',key_name='tempest-keypair-1507500110',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:03:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ddad3485d01c477c991081ef2824ebcb',ramdisk_id='',reservation_id='r-860rxtho',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2056256375',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2056256375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:03:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2642005473594fb6b5025b9287badf37',uuid=0c6d8857-57c4-49da-8fd2-72b7bfacb8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Converting VIF {"id": "ef83a02a-32fc-4d4b-8801-55bccce74380", "address": "fa:16:3e:85:71:0a", "network": {"id": "3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-392559326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ddad3485d01c477c991081ef2824ebcb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef83a02a-32", "ovs_interfaceid": "ef83a02a-32fc-4d4b-8801-55bccce74380", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:71:0a,bridge_name='br-int',has_traffic_filtering=True,id=ef83a02a-32fc-4d4b-8801-55bccce74380,network=Network(3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef83a02a-32') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG os_vif [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:71:0a,bridge_name='br-int',has_traffic_filtering=True,id=ef83a02a-32fc-4d4b-8801-55bccce74380,network=Network(3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef83a02a-32') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef83a02a-32, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c2c0d9c-f193-4d77-b4d2-af973c6f1252) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:45 user nova-compute[75305]: INFO os_vif [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:71:0a,bridge_name='br-int',has_traffic_filtering=True,id=ef83a02a-32fc-4d4b-8801-55bccce74380,network=Network(3f2dcc0e-bb4e-4b1b-bed8-a3246ce65c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef83a02a-32')
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Deleting instance files /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6_del
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Deletion of /opt/stack/data/nova/instances/0c6d8857-57c4-49da-8fd2-72b7bfacb8c6_del complete
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.compute.manager [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:45 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Took 0.69 seconds to deallocate network for instance.
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-1e0a1f75-7294-4f9c-8f62-123847b6bb7c req-39e0d99b-2f99-438d-97c2-a05310a0219c service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-vif-deleted-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.compute.manager [req-1e0a1f75-7294-4f9c-8f62-123847b6bb7c req-39e0d99b-2f99-438d-97c2-a05310a0219c service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Neutron deleted interface 43bdf938-f392-40d2-9a72-46930577a7f0; detaching it from the instance and deleting it from the info cache
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-1e0a1f75-7294-4f9c-8f62-123847b6bb7c req-39e0d99b-2f99-438d-97c2-a05310a0219c service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:45 user nova-compute[75305]: WARNING nova.volume.cinder [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Attachment 360506d4-3f71-4be1-b0e4-f42a02525851 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 360506d4-3f71-4be1-b0e4-f42a02525851. (HTTP 404) (Request-ID: req-3fccf93b-540e-432b-96e4-8144707fba9e)
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.compute.manager [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Took 0.02 seconds to detach 1 volumes for instance.
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-1e0a1f75-7294-4f9c-8f62-123847b6bb7c req-39e0d99b-2f99-438d-97c2-a05310a0219c service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Detach interface failed, port_id=43bdf938-f392-40d2-9a72-46930577a7f0, reason: Instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:45 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Deleted allocations for instance 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1cd9d1d9-1091-4a46-bb70-a94c3152a271 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.182s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:46 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Took 0.95 seconds to deallocate network for instance.
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4ca9cd81-0f12-4914-a919-63ae61720234 req-d6c621ee-caad-4286-97cb-f8b0e34e52bd service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received event network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4ca9cd81-0f12-4914-a919-63ae61720234 req-d6c621ee-caad-4286-97cb-f8b0e34e52bd service nova] Acquiring lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4ca9cd81-0f12-4914-a919-63ae61720234 req-d6c621ee-caad-4286-97cb-f8b0e34e52bd service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4ca9cd81-0f12-4914-a919-63ae61720234 req-d6c621ee-caad-4286-97cb-f8b0e34e52bd service nova] Lock "91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4ca9cd81-0f12-4914-a919-63ae61720234 req-d6c621ee-caad-4286-97cb-f8b0e34e52bd service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] No waiting events found dispatching network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:46 user nova-compute[75305]: WARNING nova.compute.manager [req-4ca9cd81-0f12-4914-a919-63ae61720234 req-d6c621ee-caad-4286-97cb-f8b0e34e52bd service nova] [instance: 91e60c0b-0249-4e1e-9b8e-3f9aaa6c5e3a] Received unexpected event network-vif-plugged-43bdf938-f392-40d2-9a72-46930577a7f0 for instance with vm_state deleted and task_state None.
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-4ca9cd81-0f12-4914-a919-63ae61720234 req-d6c621ee-caad-4286-97cb-f8b0e34e52bd service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-vif-deleted-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:46 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Deleted allocations for instance 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bbe73c2d-ece7-4477-8ba8-9607923c8ccf tempest-VolumesAssistedSnapshotsTest-2056256375 tempest-VolumesAssistedSnapshotsTest-2056256375-project-member] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.246s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-c0fe8ba1-8725-4a8d-ab7c-60b8837a536b req-acaa883e-f37a-4bb1-b085-3ed818c04abc service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received event network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c0fe8ba1-8725-4a8d-ab7c-60b8837a536b req-acaa883e-f37a-4bb1-b085-3ed818c04abc service nova] Acquiring lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c0fe8ba1-8725-4a8d-ab7c-60b8837a536b req-acaa883e-f37a-4bb1-b085-3ed818c04abc service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c0fe8ba1-8725-4a8d-ab7c-60b8837a536b req-acaa883e-f37a-4bb1-b085-3ed818c04abc service nova] Lock "0c6d8857-57c4-49da-8fd2-72b7bfacb8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-c0fe8ba1-8725-4a8d-ab7c-60b8837a536b req-acaa883e-f37a-4bb1-b085-3ed818c04abc service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] No waiting events found dispatching network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:46 user nova-compute[75305]: WARNING nova.compute.manager [req-c0fe8ba1-8725-4a8d-ab7c-60b8837a536b req-acaa883e-f37a-4bb1-b085-3ed818c04abc service nova] [instance: 0c6d8857-57c4-49da-8fd2-72b7bfacb8c6] Received unexpected event network-vif-plugged-ef83a02a-32fc-4d4b-8801-55bccce74380 for instance with vm_state deleted and task_state None.
Nov 14 08:05:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:55 user nova-compute[75305]: INFO nova.compute.manager [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Terminating instance
Nov 14 08:05:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-55cebf64-88a4-4cdf-b88c-24d67484c0b9 req-c5fbb8ce-0612-4c49-9d75-d65a075e3903 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-unplugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-55cebf64-88a4-4cdf-b88c-24d67484c0b9 req-c5fbb8ce-0612-4c49-9d75-d65a075e3903 service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-55cebf64-88a4-4cdf-b88c-24d67484c0b9 req-c5fbb8ce-0612-4c49-9d75-d65a075e3903 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-55cebf64-88a4-4cdf-b88c-24d67484c0b9 req-c5fbb8ce-0612-4c49-9d75-d65a075e3903 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-55cebf64-88a4-4cdf-b88c-24d67484c0b9 req-c5fbb8ce-0612-4c49-9d75-d65a075e3903 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-unplugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-55cebf64-88a4-4cdf-b88c-24d67484c0b9 req-c5fbb8ce-0612-4c49-9d75-d65a075e3903 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-unplugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Instance destroyed successfully.
Nov 14 08:05:56 user nova-compute[75305]: DEBUG nova.objects.instance [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lazy-loading 'resources' on Instance uuid 186a5286-ecc4-43e6-aea3-2529ddd72b58 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T08:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1209143005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1209143005',id=7,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXca1vYSHzriNFxI4HJL7f+3+PplNwsH+bAFf1mYAkPXMIeJiULQBFkSdPS/Per98VskylBIEcPjxnfMp2q88hKfXr/J3YkWMjJpGd1wg6tf6AHpPpPKsIfqKh1wCy7kw==',key_name='tempest-keypair-1683451519',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed60def7f2d441fcb3147dc96fdce086',ramdisk_id='',reservation_id='r-bmmp07xd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-745059634',owner_user_name='tempest-TaggedAttachmentsTest-745059634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c90e99f86334376bdbfd4b76263fd15',uuid=186a5286-ecc4-43e6-aea3-2529ddd72b58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converting VIF {"id": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "address": "fa:16:3e:74:b6:cb", "network": {"id": "ed0901ec-8392-4a40-9a10-33cdb8f2e6aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-56715715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ed60def7f2d441fcb3147dc96fdce086", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88edc6a5-97", "ovs_interfaceid": "88edc6a5-9716-411e-8ea6-9da3cac488d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=88edc6a5-9716-411e-8ea6-9da3cac488d0,network=Network(ed0901ec-8392-4a40-9a10-33cdb8f2e6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88edc6a5-97') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG os_vif [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=88edc6a5-9716-411e-8ea6-9da3cac488d0,network=Network(ed0901ec-8392-4a40-9a10-33cdb8f2e6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88edc6a5-97') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88edc6a5-97, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d99518a9-8df9-43d2-b8af-278d8dd69730) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:56 user nova-compute[75305]: INFO os_vif [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:b6:cb,bridge_name='br-int',has_traffic_filtering=True,id=88edc6a5-9716-411e-8ea6-9da3cac488d0,network=Network(ed0901ec-8392-4a40-9a10-33cdb8f2e6aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88edc6a5-97')
Nov 14 08:05:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Deleting instance files /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58_del
Nov 14 08:05:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Deletion of /opt/stack/data/nova/instances/186a5286-ecc4-43e6-aea3-2529ddd72b58_del complete
Nov 14 08:05:56 user nova-compute[75305]: INFO nova.compute.manager [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:56 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "49ae6a17-49eb-4334-b517-1280009ae794" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "49ae6a17-49eb-4334-b517-1280009ae794" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "49ae6a17-49eb-4334-b517-1280009ae794-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:57 user nova-compute[75305]: INFO nova.compute.manager [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Terminating instance
Nov 14 08:05:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:57 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Took 1.56 seconds to deallocate network for instance.
Nov 14 08:05:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-8e20ed90-88fe-4145-bf96-8df42afb2d67 req-10c31dd4-3c78-484e-9faf-03eab6cecf24 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-deleted-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-c18496c2-6045-4828-9b84-46edc77614e8 req-e356ad40-a1b7-4fe4-ac00-01d83179b1a6 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received event network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c18496c2-6045-4828-9b84-46edc77614e8 req-e356ad40-a1b7-4fe4-ac00-01d83179b1a6 service nova] Acquiring lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c18496c2-6045-4828-9b84-46edc77614e8 req-e356ad40-a1b7-4fe4-ac00-01d83179b1a6 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c18496c2-6045-4828-9b84-46edc77614e8 req-e356ad40-a1b7-4fe4-ac00-01d83179b1a6 service nova] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-c18496c2-6045-4828-9b84-46edc77614e8 req-e356ad40-a1b7-4fe4-ac00-01d83179b1a6 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] No waiting events found dispatching network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:57 user nova-compute[75305]: WARNING nova.compute.manager [req-c18496c2-6045-4828-9b84-46edc77614e8 req-e356ad40-a1b7-4fe4-ac00-01d83179b1a6 service nova] [instance: 186a5286-ecc4-43e6-aea3-2529ddd72b58] Received unexpected event network-vif-plugged-88edc6a5-9716-411e-8ea6-9da3cac488d0 for instance with vm_state active and task_state deleting.
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ea8c8fd-6c4e-4947-86d1-adae59ff88e1 req-ad40a4c9-9ec5-4746-99be-6f6083206a56 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received event network-vif-unplugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ea8c8fd-6c4e-4947-86d1-adae59ff88e1 req-ad40a4c9-9ec5-4746-99be-6f6083206a56 service nova] Acquiring lock "49ae6a17-49eb-4334-b517-1280009ae794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ea8c8fd-6c4e-4947-86d1-adae59ff88e1 req-ad40a4c9-9ec5-4746-99be-6f6083206a56 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ea8c8fd-6c4e-4947-86d1-adae59ff88e1 req-ad40a4c9-9ec5-4746-99be-6f6083206a56 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ea8c8fd-6c4e-4947-86d1-adae59ff88e1 req-ad40a4c9-9ec5-4746-99be-6f6083206a56 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] No waiting events found dispatching network-vif-unplugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ea8c8fd-6c4e-4947-86d1-adae59ff88e1 req-ad40a4c9-9ec5-4746-99be-6f6083206a56 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received event network-vif-unplugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:58 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Deleted allocations for instance 186a5286-ecc4-43e6-aea3-2529ddd72b58
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-889e2b76-c15e-4eab-8678-cf8a8dea8268 tempest-TaggedAttachmentsTest-745059634 tempest-TaggedAttachmentsTest-745059634-project-member] Lock "186a5286-ecc4-43e6-aea3-2529ddd72b58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.022s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Instance destroyed successfully.
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lazy-loading 'resources' on Instance uuid 49ae6a17-49eb-4334-b517-1280009ae794 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2027456936',display_name='tempest-ServersNegativeTestJSON-server-2027456936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2027456936',id=13,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='527bf1ca93e8450293e5228c6ee1931f',ramdisk_id='',reservation_id='r-fbcfznkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-281828421',owner_user_name='tempest-ServersNegativeTestJSON-281828421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:04:16Z,user_data=None,user_id='b6126101718a429183c2553d9b552360',uuid=49ae6a17-49eb-4334-b517-1280009ae794,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converting VIF {"id": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "address": "fa:16:3e:18:69:5b", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21ce6c08-9e", "ovs_interfaceid": "21ce6c08-9e5b-4cae-88eb-948fdda16ab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:5b,bridge_name='br-int',has_traffic_filtering=True,id=21ce6c08-9e5b-4cae-88eb-948fdda16ab2,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce6c08-9e') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG os_vif [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:5b,bridge_name='br-int',has_traffic_filtering=True,id=21ce6c08-9e5b-4cae-88eb-948fdda16ab2,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce6c08-9e') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21ce6c08-9e, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=806fb8ac-bd82-4911-88c0-0de9b8de69f5) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:05:58 user nova-compute[75305]: INFO os_vif [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:69:5b,bridge_name='br-int',has_traffic_filtering=True,id=21ce6c08-9e5b-4cae-88eb-948fdda16ab2,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21ce6c08-9e')
Nov 14 08:05:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Deleting instance files /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794_del
Nov 14 08:05:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Deletion of /opt/stack/data/nova/instances/49ae6a17-49eb-4334-b517-1280009ae794_del complete
Nov 14 08:05:58 user nova-compute[75305]: INFO nova.compute.manager [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 08:05:58 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:05:58 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:05:59 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:05:59 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Took 0.64 seconds to deallocate network for instance.
Nov 14 08:05:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:05:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:05:59 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:05:59 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:05:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.330s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:59 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Deleted allocations for instance 49ae6a17-49eb-4334-b517-1280009ae794
Nov 14 08:05:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9da7f6e9-5d51-4dd7-9ddd-057bf77b3cdc tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "49ae6a17-49eb-4334-b517-1280009ae794" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:05:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-49954841-3e5b-401e-8d86-299ec347a415 req-beb5b51e-9270-4894-a041-2ea02b49b4c1 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received event network-vif-deleted-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-84ff1e88-030d-4119-8247-6beda42f833f req-7a40aee8-4998-4a22-9632-7de6b88add30 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received event network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-84ff1e88-030d-4119-8247-6beda42f833f req-7a40aee8-4998-4a22-9632-7de6b88add30 service nova] Acquiring lock "49ae6a17-49eb-4334-b517-1280009ae794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-84ff1e88-030d-4119-8247-6beda42f833f req-7a40aee8-4998-4a22-9632-7de6b88add30 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-84ff1e88-030d-4119-8247-6beda42f833f req-7a40aee8-4998-4a22-9632-7de6b88add30 service nova] Lock "49ae6a17-49eb-4334-b517-1280009ae794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-84ff1e88-030d-4119-8247-6beda42f833f req-7a40aee8-4998-4a22-9632-7de6b88add30 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] No waiting events found dispatching network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:00 user nova-compute[75305]: WARNING nova.compute.manager [req-84ff1e88-030d-4119-8247-6beda42f833f req-7a40aee8-4998-4a22-9632-7de6b88add30 service nova] [instance: 49ae6a17-49eb-4334-b517-1280009ae794] Received unexpected event network-vif-plugged-21ce6c08-9e5b-4cae-88eb-948fdda16ab2 for instance with vm_state deleted and task_state None.
Nov 14 08:06:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'flavor' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:03 user nova-compute[75305]: INFO nova.compute.manager [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Attaching volume 5db9188d-0523-467c-af2a-329ee663d088 to /dev/vdb
Nov 14 08:06:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG os_brick.utils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec3cdd0-87c0-423e-905d-e8b37c9472f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.082s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c6fc0c-61fa-418b-b083-85f8dc42c483]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[576f4579-5cdf-4ff1-a597-92a4d6e51d68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c089ba8f-e8a5-4076-8869-b9720343ccd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:06:03 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c906b6c-7b3a-4e11-95f9-59978a0aa9b8]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG os_brick.utils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating existing volume attachment record: 61303b1b-c123-4c2d-ab34-8f51c7cd3a9a {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lazy-loading 'flavor' on Instance uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:06:04 user nova-compute[75305]: INFO nova.compute.claims [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Claim successful on node user
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:04 user nova-compute[75305]: INFO nova.compute.manager [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Attaching volume 47c805e5-5129-493e-94e7-1fd4a5235d33 to /dev/vdb
Nov 14 08:06:04 user nova-compute[75305]: DEBUG os_brick.utils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fda05d8-98f0-4941-ba1a-557975459010]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1690fc8-37a8-458a-8ef0-d996591aa2de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a44d35e-78ca-49df-b3fc-6fc36d25fdd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a08e08-d8fd-4cdd-8ee1-e2947ef33381]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:06:04 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb83d139-3e07-4362-b426-64b0635faee7]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG os_brick.utils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating existing volume attachment record: 7e718f95-9ebf-480e-af93-94a1d35af728 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:06:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.policy [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '574c9a82a4994bdcb60c5d96b199d69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a93139587f4dc0b2bd586961056c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:06:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Creating image(s)
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk 1073741824" returned: 0 in 0.057s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Successfully created port: 2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.221s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Cannot resize image /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Ensure instance console log exists: /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Successfully updated port: 2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquired lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-changed-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Refreshing instance network info cache due to event network-changed-2cca97fb-fc47-47b5-a480-2082f53a52db. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] Acquiring lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updating instance_info_cache with network_info: [{"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Releasing lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance network_info: |[{"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] Acquired lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.neutron [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Refreshing network info cache for port 2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Start _get_guest_xml network_info=[{"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:06:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-282595868',display_name='tempest-tempest.common.compute-instance-282595868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-282595868',id=15,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATQaebgY6FVuDzfByi4n+NZkAFhSWDDR3cOgUOfYqPhuzhPRZQAh2rqky1pom02R6jbd5n7JWx9caNElsIemhUwnvUJsbZN0JtdgFrUe+kcbMjv4SOyBmEz18HgXewRhg==',key_name='tempest-keypair-1756979960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-jrdab4sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=1a8e1fa0-e30d-4940-b08d-15cfe8b1737e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.objects.instance [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:06:06 user nova-compute[75305]:   <uuid>1a8e1fa0-e30d-4940-b08d-15cfe8b1737e</uuid>
Nov 14 08:06:06 user nova-compute[75305]:   <name>instance-0000000f</name>
Nov 14 08:06:06 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:06:06 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:06:06 user nova-compute[75305]:   <metadata>
Nov 14 08:06:06 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:06:06 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:06:06 user nova-compute[75305]:       <nova:name>tempest-tempest.common.compute-instance-282595868</nova:name>
Nov 14 08:06:06 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:06:06</nova:creationTime>
Nov 14 08:06:06 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:06:06 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:06:06 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:06:06 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:06:06 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:06:06 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:06:06 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:06:06 user nova-compute[75305]:       <nova:owner>
Nov 14 08:06:06 user nova-compute[75305]:         <nova:user uuid="574c9a82a4994bdcb60c5d96b199d69a">tempest-ServerActionsTestOtherA-723782501-project-member</nova:user>
Nov 14 08:06:06 user nova-compute[75305]:         <nova:project uuid="34a93139587f4dc0b2bd586961056c6c">tempest-ServerActionsTestOtherA-723782501</nova:project>
Nov 14 08:06:06 user nova-compute[75305]:       </nova:owner>
Nov 14 08:06:06 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:06:06 user nova-compute[75305]:       <nova:ports>
Nov 14 08:06:06 user nova-compute[75305]:         <nova:port uuid="2cca97fb-fc47-47b5-a480-2082f53a52db">
Nov 14 08:06:06 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 08:06:06 user nova-compute[75305]:         </nova:port>
Nov 14 08:06:06 user nova-compute[75305]:       </nova:ports>
Nov 14 08:06:06 user nova-compute[75305]:     </nova:instance>
Nov 14 08:06:06 user nova-compute[75305]:   </metadata>
Nov 14 08:06:06 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:06:06 user nova-compute[75305]:     <system>
Nov 14 08:06:06 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:06:06 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:06:06 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:06:06 user nova-compute[75305]:       <entry name="serial">1a8e1fa0-e30d-4940-b08d-15cfe8b1737e</entry>
Nov 14 08:06:06 user nova-compute[75305]:       <entry name="uuid">1a8e1fa0-e30d-4940-b08d-15cfe8b1737e</entry>
Nov 14 08:06:06 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:06:06 user nova-compute[75305]:     </system>
Nov 14 08:06:06 user nova-compute[75305]:   </sysinfo>
Nov 14 08:06:06 user nova-compute[75305]:   <os>
Nov 14 08:06:06 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:06:06 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:06:06 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:06:06 user nova-compute[75305]:   </os>
Nov 14 08:06:06 user nova-compute[75305]:   <features>
Nov 14 08:06:06 user nova-compute[75305]:     <acpi/>
Nov 14 08:06:06 user nova-compute[75305]:     <apic/>
Nov 14 08:06:06 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:06:06 user nova-compute[75305]:   </features>
Nov 14 08:06:06 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:06:06 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:06:06 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:06:06 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:06:06 user nova-compute[75305]:   </clock>
Nov 14 08:06:06 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:06:06 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:06:06 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:06:06 user nova-compute[75305]:   </cpu>
Nov 14 08:06:06 user nova-compute[75305]:   <devices>
Nov 14 08:06:06 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:06:06 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:06:06 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk"/>
Nov 14 08:06:06 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:06:06 user nova-compute[75305]:     </disk>
Nov 14 08:06:06 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:06:06 user nova-compute[75305]:       <mac address="fa:16:3e:b4:e9:01"/>
Nov 14 08:06:06 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:06 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:06:06 user nova-compute[75305]:       <target dev="tap2cca97fb-fc"/>
Nov 14 08:06:06 user nova-compute[75305]:     </interface>
Nov 14 08:06:06 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:06:06 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/console.log" append="off"/>
Nov 14 08:06:06 user nova-compute[75305]:     </serial>
Nov 14 08:06:06 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:06:06 user nova-compute[75305]:     <video>
Nov 14 08:06:06 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:06 user nova-compute[75305]:     </video>
Nov 14 08:06:06 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:06:06 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:06:06 user nova-compute[75305]:     </rng>
Nov 14 08:06:06 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:06:06 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:06:06 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:06:06 user nova-compute[75305]:     </memballoon>
Nov 14 08:06:06 user nova-compute[75305]:   </devices>
Nov 14 08:06:06 user nova-compute[75305]: </domain>
Nov 14 08:06:06 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-282595868',display_name='tempest-tempest.common.compute-instance-282595868',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-282595868',id=15,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATQaebgY6FVuDzfByi4n+NZkAFhSWDDR3cOgUOfYqPhuzhPRZQAh2rqky1pom02R6jbd5n7JWx9caNElsIemhUwnvUJsbZN0JtdgFrUe+kcbMjv4SOyBmEz18HgXewRhg==',key_name='tempest-keypair-1756979960',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-jrdab4sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=1a8e1fa0-e30d-4940-b08d-15cfe8b1737e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG os_vif [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c5e88e6-d3a9-54ed-8a7f-8b69ffaa86d7', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cca97fb-fc, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cca97fb-fc, col_values=(('qos', UUID('d5eff7ec-de55-4e7b-b229-c0b855a8e602')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cca97fb-fc, col_values=(('external_ids', {'iface-id': '2cca97fb-fc47-47b5-a480-2082f53a52db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:e9:01', 'vm-uuid': '1a8e1fa0-e30d-4940-b08d-15cfe8b1737e'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:06 user nova-compute[75305]: INFO os_vif [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc')
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No VIF found with MAC fa:16:3e:b4:e9:01, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:07 user nova-compute[75305]: DEBUG nova.network.neutron [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updated VIF entry in instance network info cache for port 2cca97fb-fc47-47b5-a480-2082f53a52db. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:06:07 user nova-compute[75305]: DEBUG nova.network.neutron [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updating instance_info_cache with network_info: [{"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e48de541-2b39-48d5-b692-31e5ea90a5cd req-c35113fe-6e0d-4e88-89e6-7f7201bbcd04 service nova] Releasing lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWEaTcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:08 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:08 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:08 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3fd87c5b-8ca9-4645-8f42-f0d988011bb2 req-aa736a4d-cef6-413f-8b86-88ddf17f53d9 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3fd87c5b-8ca9-4645-8f42-f0d988011bb2 req-aa736a4d-cef6-413f-8b86-88ddf17f53d9 service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3fd87c5b-8ca9-4645-8f42-f0d988011bb2 req-aa736a4d-cef6-413f-8b86-88ddf17f53d9 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3fd87c5b-8ca9-4645-8f42-f0d988011bb2 req-aa736a4d-cef6-413f-8b86-88ddf17f53d9 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-3fd87c5b-8ca9-4645-8f42-f0d988011bb2 req-aa736a4d-cef6-413f-8b86-88ddf17f53d9 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:08 user nova-compute[75305]: WARNING nova.compute.manager [req-3fd87c5b-8ca9-4645-8f42-f0d988011bb2 req-aa736a4d-cef6-413f-8b86-88ddf17f53d9 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received unexpected event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with vm_state building and task_state spawning.
Nov 14 08:06:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a407091-b5a8-49d0-8d2f-f4101cbfa478]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:06:08 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ea39d-474c-4586-b3d5-67dccc71ba18]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088] added
Nov 14 08:06:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[775eab61-cf9b-4c7f-b22c-f0586d4e1b59]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc66a1ae-24e6-4a64-99fc-a1d2200172a1]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuWEaTcL {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuWEaTcL" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d36e2e-ec26-44f1-96c8-a42c88d6c933]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuWEaTcL'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d59f080-ee0f-4d5a-abad-e09fa6510ba9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12207a68-c1bd-43c1-bd49-44c12a4b4801]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e06f82-e728-4162-a9cd-2b673962a4ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260]
Nov 14 08:06:08 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260] successful.
Nov 14 08:06:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16b3e49-9c42-482d-a864-c61c912c476d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc095651-c581-4cf1-8523-7379de51d8a8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:09 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:09 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[09444b98-737a-4bda-9e4f-2c0cddd583f6]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWEaTcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:09 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '23465626335323961', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465626335323961', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.689s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:10 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:10 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'flavor' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260" returned: 21 in 0.034s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a90df9-57ad-46eb-9149-237bfbbe2a85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:06:10 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:06:10 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:06:10 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:06:10 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:06:10 user nova-compute[75305]:   <serial>5db9188d-0523-467c-af2a-329ee663d088</serial>
Nov 14 08:06:10 user nova-compute[75305]: </disk>
Nov 14 08:06:10 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[773ee678-ff32-477f-866f-04e03a56feac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33] added
Nov 14 08:06:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b00454-1290-4758-8b03-1310e6625a80]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e00595-8944-4f8c-a8f9-05aab50573ff]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFYybEUk {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFYybEUk" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17bf970-d973-4cf1-96e1-2ccbc04a7f6e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFYybEUk'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dc0622-6973-4c80-9770-1457f885ae69]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e56119-af52-41f6-8382-fd28ba016f63]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bb1999-8808-413e-b01d-3d8a5911ea11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]
Nov 14 08:06:10 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.
Nov 14 08:06:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a247ee0-829d-4af7-830b-d09cc52e1fd0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0043fe18-1f51-4b37-a049-44e5b6deceb6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:10 user nova-compute[75305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:10 user nova-compute[75305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:10 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:10 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b767c453-5028-4366-a31d-9f036e5b872d]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No VIF found with MAC fa:16:3e:97:d5:dc, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d0eb3cfe-602d-42b6-8edf-1c3ef8ce8969 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.261s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-44422147-0987-4a8e-85bc-4cc9c424cee2 req-07f90113-bdef-4a22-8c78-dad4c98a18a2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44422147-0987-4a8e-85bc-4cc9c424cee2 req-07f90113-bdef-4a22-8c78-dad4c98a18a2 service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44422147-0987-4a8e-85bc-4cc9c424cee2 req-07f90113-bdef-4a22-8c78-dad4c98a18a2 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44422147-0987-4a8e-85bc-4cc9c424cee2 req-07f90113-bdef-4a22-8c78-dad4c98a18a2 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-44422147-0987-4a8e-85bc-4cc9c424cee2 req-07f90113-bdef-4a22-8c78-dad4c98a18a2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:10 user nova-compute[75305]: WARNING nova.compute.manager [req-44422147-0987-4a8e-85bc-4cc9c424cee2 req-07f90113-bdef-4a22-8c78-dad4c98a18a2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received unexpected event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with vm_state building and task_state spawning.
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:06:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance spawned successfully.
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:10 user nova-compute[75305]: INFO nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 14 08:06:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:06:11 user nova-compute[75305]: INFO nova.compute.manager [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Took 7.11 seconds to build instance.
Nov 14 08:06:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-010957b1-94e0-43ad-8792-1c60260135c0 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.237s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== connect_volume: return (2057ms) {'type': 'block', 'scsi_wwn': '26430653834353534', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430653834353534', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lazy-loading 'flavor' on Instance uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:06:11 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:06:11 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:06:11 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:06:11 user nova-compute[75305]:   <serial>47c805e5-5129-493e-94e7-1fd4a5235d33</serial>
Nov 14 08:06:11 user nova-compute[75305]: </disk>
Nov 14 08:06:11 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:11 user nova-compute[75305]: INFO nova.compute.manager [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Rescuing
Nov 14 08:06:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG nova.network.neutron [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:06:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No VIF found with MAC fa:16:3e:ed:e6:07, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b2e0ef6c-8aff-4ccd-a1c2-45940e676bf6 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.048s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-98543fc3-c61e-4bca-ad1f-2af547958ca3 req-4e7decff-25c7-4980-b5eb-dfaa17e1291b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-98543fc3-c61e-4bca-ad1f-2af547958ca3 req-4e7decff-25c7-4980-b5eb-dfaa17e1291b service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-98543fc3-c61e-4bca-ad1f-2af547958ca3 req-4e7decff-25c7-4980-b5eb-dfaa17e1291b service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-98543fc3-c61e-4bca-ad1f-2af547958ca3 req-4e7decff-25c7-4980-b5eb-dfaa17e1291b service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-98543fc3-c61e-4bca-ad1f-2af547958ca3 req-4e7decff-25c7-4980-b5eb-dfaa17e1291b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:13 user nova-compute[75305]: WARNING nova.compute.manager [req-98543fc3-c61e-4bca-ad1f-2af547958ca3 req-4e7decff-25c7-4980-b5eb-dfaa17e1291b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state active and task_state rescuing.
Nov 14 08:06:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:06:13 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance destroyed successfully.
Nov 14 08:06:13 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Attempting a stable device rescue
Nov 14 08:06:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:06:13 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Creating image(s)
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG nova.objects.instance [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "ece714b799b124c9c04b245de5f605f96c509bf8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "ece714b799b124c9c04b245de5f605f96c509bf8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.part --force-share --output=json" returned: 0 in 0.206s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG nova.virt.images [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] a1b6add5-be56-430d-a2a5-80c22e79e408 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.part /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.part /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.converted" returned: 0 in 0.339s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-4fb4885f-c144-4286-9a15-c90052c33e57 req-b8effc26-0616-4779-8aab-ad20d509d19a service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4fb4885f-c144-4286-9a15-c90052c33e57 req-b8effc26-0616-4779-8aab-ad20d509d19a service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4fb4885f-c144-4286-9a15-c90052c33e57 req-b8effc26-0616-4779-8aab-ad20d509d19a service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4fb4885f-c144-4286-9a15-c90052c33e57 req-b8effc26-0616-4779-8aab-ad20d509d19a service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-4fb4885f-c144-4286-9a15-c90052c33e57 req-b8effc26-0616-4779-8aab-ad20d509d19a service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:15 user nova-compute[75305]: WARNING nova.compute.manager [req-4fb4885f-c144-4286-9a15-c90052c33e57 req-b8effc26-0616-4779-8aab-ad20d509d19a service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state active and task_state rescuing.
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8.converted --force-share --output=json" returned: 0 in 0.249s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "ece714b799b124c9c04b245de5f605f96c509bf8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.761s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "ece714b799b124c9c04b245de5f605f96c509bf8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "ece714b799b124c9c04b245de5f605f96c509bf8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-changed-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Refreshing instance network info cache due to event network-changed-f1b43dba-2876-48a4-8e38-59cc2428f26d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] Acquiring lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] Acquired lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Refreshing network info cache for port f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Stashing vm_state: active {{(pid=75305) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8 --force-share --output=json" returned: 0 in 0.243s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8,backing_fmt=raw /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8,backing_fmt=raw /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue" returned: 0 in 0.100s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "ece714b799b124c9c04b245de5f605f96c509bf8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'migration_context' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Object Instance<f5959dc8-a417-4528-9f03-3951186c2315> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Start _get_guest_xml network_info=[{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "vif_mac": "fa:16:3e:97:d5:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1b6add5-be56-430d-a2a5-80c22e79e408', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '61303b1b-c123-4c2d-ab34-8f51c7cd3a9a', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWEaTcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f5959dc8-a417-4528-9f03-3951186c2315', 'attached_at': '', 'detached_at': '', 'volume_id': '5db9188d-0523-467c-af2a-329ee663d088', 'serial': '5db9188d-0523-467c-af2a-329ee663d088'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'resources' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Object Instance<f5959dc8-a417-4528-9f03-3951186c2315> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'numa_topology' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Object Instance<f5959dc8-a417-4528-9f03-3951186c2315> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:06:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:06:15 user nova-compute[75305]: INFO nova.compute.claims [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Claim successful on node user
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.objects.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Object Instance<f5959dc8-a417-4528-9f03-3951186c2315> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWEaTcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:15 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:06:15 user nova-compute[75305]: INFO nova.compute.resource_tracker [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating resource usage from migration 01ed8c82-3f87-450b-93ba-f2be8e98d473
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7248ba2-98e1-4888-b3dd-7c0cb5d94d10]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = tuWEaTcL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 08:06:16 user nova-compute[75305]: node.name = iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:06:16 user nova-compute[75305]: node.tpgt = -1
Nov 14 08:06:16 user nova-compute[75305]: node.startup = automatic
Nov 14 08:06:16 user nova-compute[75305]: node.leading_login = No
Nov 14 08:06:16 user nova-compute[75305]: iface.iscsi_ifacename = default
Nov 14 08:06:16 user nova-compute[75305]: iface.net_ifacename = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.ipaddress = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.prefix_len = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.hwaddress = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.transport_name = tcp
Nov 14 08:06:16 user nova-compute[75305]: iface.initiatorname = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.state = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.vlan_id = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.vlan_priority = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.vlan_state = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.iface_num = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.mtu = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.port = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.bootproto = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.subnet_mask = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.gateway = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_alt_client_id = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_dns = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_learn_iqn = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_vendor_id_state = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_vendor_id = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.dhcp_slp_da = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.fragmentation = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.gratuitous_arp = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.incoming_forwarding = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.tos_state = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.tos = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.ttl = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.delayed_ack = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.tcp_nagle = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.tcp_wsf_state = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.tcp_wsf = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.tcp_timer_scale = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.tcp_timestamp = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.redirect = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.def_task_mgmt_timeout = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.header_digest = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.data_digest = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.immediate_data = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.initial_r2t = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.data_seq_inorder = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.data_pdu_inorder = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.erl = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.max_receive_data_len = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.first_burst_len = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.max_outstanding_r2t = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.max_burst_len = 0
Nov 14 08:06:16 user nova-compute[75305]: iface.chap_auth = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.bidi_chap = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.strict_login_compliance = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.discovery_auth = <empty>
Nov 14 08:06:16 user nova-compute[75305]: iface.discovery_logout = <empty>
Nov 14 08:06:16 user nova-compute[75305]: node.discovery_address = <empty>
Nov 14 08:06:16 user nova-compute[75305]: node.discovery_port = 0
Nov 14 08:06:16 user nova-compute[75305]: node.discovery_type = static
Nov 14 08:06:16 user nova-compute[75305]: node.session.initial_cmdsn = 0
Nov 14 08:06:16 user nova-compute[75305]: node.session.initial_login_retry_max = 8
Nov 14 08:06:16 user nova-compute[75305]: node.session.xmit_thread_priority = -20
Nov 14 08:06:16 user nova-compute[75305]: node.session.cmds_max = 128
Nov 14 08:06:16 user nova-compute[75305]: node.session.queue_depth = 32
Nov 14 08:06:16 user nova-compute[75305]: node.session.nr_sessions = 1
Nov 14 08:06:16 user nova-compute[75305]: node.session.auth.authmethod = CHAP
Nov 14 08:06:16 user nova-compute[75305]: node.session.auth.username = tuWEaTcL
Nov 14 08:06:16 user nova-compute[75305]: node.session.auth.password = ***
Nov 14 08:06:16 user nova-compute[75305]: node.session.auth.username_in = <empty>
Nov 14 08:06:16 user nova-compute[75305]: node.session.auth.password_in = <empty>
Nov 14 08:06:16 user nova-compute[75305]: node.session.auth.chap_algs = MD5
Nov 14 08:06:16 user nova-compute[75305]: node.session.timeo.replacement_timeout = 120
Nov 14 08:06:16 user nova-compute[75305]: node.session.err_timeo.abort_timeout = 15
Nov 14 08:06:16 user nova-compute[75305]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 08:06:16 user nova-compute[75305]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 08:06:16 user nova-compute[75305]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.FastAbort = Yes
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.InitialR2T = No
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.ImmediateData = Yes
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.MaxConnections = 1
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 08:06:16 user nova-compute[75305]: node.session.iscsi.ERL = 0
Nov 14 08:06:16 user nova-compute[75305]: node.session.scan = manual
Nov 14 08:06:16 user nova-compute[75305]: node.session.reopen_max = 0
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].address = 172.16.0.220
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].port = 3260
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].startup = manual
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].tcp.window_size = 524288
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].tcp.type_of_service = 0
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].timeo.logout_timeout = 15
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].timeo.login_timeout = 15
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].timeo.auth_timeout = 45
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].iscsi.DataDigest = None
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].iscsi.IFMarker = No
Nov 14 08:06:16 user nova-compute[75305]: node.conn[0].iscsi.OFMarker = No
Nov 14 08:06:16 user nova-compute[75305]: # END RECORD
Nov 14 08:06:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:16 user nova-compute[75305]: INFO nova.compute.manager [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Terminating instance
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f586f5-10d4-4f35-bef7-6874990e330e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e35c12-038b-4217-b35b-5343d1ab2736]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuWEaTcL {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuWEaTcL" returned: 0 in 0.037s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd2cb47-304e-46d0-b4cc-0589d5802b81]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuWEaTcL'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8d0160-e6c3-4b70-8a6a-248a42516b86]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecd9d66-aa74-4b02-93b4-47748771a2f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:16 user nova-compute[75305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:16 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:16 user nova-compute[75305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:16 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c9591d-b673-4fcc-922a-7eea2d20ad80]: (4, ('0 0 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWEaTcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.341s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] <== connect_volume: return (342ms) {'type': 'block', 'scsi_wwn': '23465626335323961', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465626335323961', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-943852596',display_name='tempest-ServerStableDeviceRescueTest-server-943852596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-943852596',id=3,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5yoSnB7TPx2ScUHUeCSeilBC6NPHdqO/tlTcNF4+qm6O99Zzd7+sVaj7DbuusQ21GcjrgPt0ZWBVmhYkzdVe4Qy9hFQIiVYujxr2o4UKvSp4MMiIV/5ORL5AoTD5Zjng==',key_name='tempest-keypair-1894394159',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fa8ff9cd1d54897a96c555021604b00',ramdisk_id='',reservation_id='r-0f8a7vk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1375221339',owner_user_name='tempest-ServerStableDeviceRescueTest-1375221339-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18e38ea4aaf84e82afd404b88ae4d6cc',uuid=f5959dc8-a417-4528-9f03-3951186c2315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "vif_mac": "fa:16:3e:97:d5:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converting VIF {"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "vif_mac": "fa:16:3e:97:d5:dc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.objects.instance [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'pci_devices' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.objects.base [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Object Instance<f5959dc8-a417-4528-9f03-3951186c2315> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:06:16 user nova-compute[75305]:   <uuid>f5959dc8-a417-4528-9f03-3951186c2315</uuid>
Nov 14 08:06:16 user nova-compute[75305]:   <name>instance-00000003</name>
Nov 14 08:06:16 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:06:16 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:06:16 user nova-compute[75305]:   <metadata>
Nov 14 08:06:16 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:06:16 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:06:16 user nova-compute[75305]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-943852596</nova:name>
Nov 14 08:06:16 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:06:15</nova:creationTime>
Nov 14 08:06:16 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:06:16 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:06:16 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:06:16 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:06:16 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:06:16 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:06:16 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:06:16 user nova-compute[75305]:       <nova:owner>
Nov 14 08:06:16 user nova-compute[75305]:         <nova:user uuid="18e38ea4aaf84e82afd404b88ae4d6cc">tempest-ServerStableDeviceRescueTest-1375221339-project-member</nova:user>
Nov 14 08:06:16 user nova-compute[75305]:         <nova:project uuid="1fa8ff9cd1d54897a96c555021604b00">tempest-ServerStableDeviceRescueTest-1375221339</nova:project>
Nov 14 08:06:16 user nova-compute[75305]:       </nova:owner>
Nov 14 08:06:16 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:06:16 user nova-compute[75305]:       <nova:ports>
Nov 14 08:06:16 user nova-compute[75305]:         <nova:port uuid="11d90697-5697-4fd9-8284-99e99196df6e">
Nov 14 08:06:16 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:06:16 user nova-compute[75305]:         </nova:port>
Nov 14 08:06:16 user nova-compute[75305]:       </nova:ports>
Nov 14 08:06:16 user nova-compute[75305]:     </nova:instance>
Nov 14 08:06:16 user nova-compute[75305]:   </metadata>
Nov 14 08:06:16 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:06:16 user nova-compute[75305]:     <system>
Nov 14 08:06:16 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:06:16 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:06:16 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:06:16 user nova-compute[75305]:       <entry name="serial">f5959dc8-a417-4528-9f03-3951186c2315</entry>
Nov 14 08:06:16 user nova-compute[75305]:       <entry name="uuid">f5959dc8-a417-4528-9f03-3951186c2315</entry>
Nov 14 08:06:16 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:06:16 user nova-compute[75305]:     </system>
Nov 14 08:06:16 user nova-compute[75305]:   </sysinfo>
Nov 14 08:06:16 user nova-compute[75305]:   <os>
Nov 14 08:06:16 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:06:16 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:06:16 user nova-compute[75305]:   </os>
Nov 14 08:06:16 user nova-compute[75305]:   <features>
Nov 14 08:06:16 user nova-compute[75305]:     <acpi/>
Nov 14 08:06:16 user nova-compute[75305]:     <apic/>
Nov 14 08:06:16 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:06:16 user nova-compute[75305]:   </features>
Nov 14 08:06:16 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:06:16 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:06:16 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:06:16 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:06:16 user nova-compute[75305]:   </clock>
Nov 14 08:06:16 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:06:16 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:06:16 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:06:16 user nova-compute[75305]:   </cpu>
Nov 14 08:06:16 user nova-compute[75305]:   <devices>
Nov 14 08:06:16 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:06:16 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:06:16 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk"/>
Nov 14 08:06:16 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:06:16 user nova-compute[75305]:     </disk>
Nov 14 08:06:16 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:06:16 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:06:16 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:06:16 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:06:16 user nova-compute[75305]:       <serial>5db9188d-0523-467c-af2a-329ee663d088</serial>
Nov 14 08:06:16 user nova-compute[75305]:     </disk>
Nov 14 08:06:16 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:06:16 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:06:16 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue"/>
Nov 14 08:06:16 user nova-compute[75305]:       <target dev="vdc" bus="virtio"/>
Nov 14 08:06:16 user nova-compute[75305]:       <boot order="1"/>
Nov 14 08:06:16 user nova-compute[75305]:     </disk>
Nov 14 08:06:16 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:06:16 user nova-compute[75305]:       <mac address="fa:16:3e:97:d5:dc"/>
Nov 14 08:06:16 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:16 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:06:16 user nova-compute[75305]:       <target dev="tap11d90697-56"/>
Nov 14 08:06:16 user nova-compute[75305]:     </interface>
Nov 14 08:06:16 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:06:16 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/console.log" append="off"/>
Nov 14 08:06:16 user nova-compute[75305]:     </serial>
Nov 14 08:06:16 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:06:16 user nova-compute[75305]:     <video>
Nov 14 08:06:16 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:16 user nova-compute[75305]:     </video>
Nov 14 08:06:16 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:06:16 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:06:16 user nova-compute[75305]:     </rng>
Nov 14 08:06:16 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:06:16 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:06:16 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:06:16 user nova-compute[75305]:     </memballoon>
Nov 14 08:06:16 user nova-compute[75305]:   </devices>
Nov 14 08:06:16 user nova-compute[75305]: </domain>
Nov 14 08:06:16 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:06:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance destroyed successfully.
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.623s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:16 user nova-compute[75305]: INFO nova.compute.manager [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Migrating
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:16 user nova-compute[75305]: INFO nova.compute.rpcapi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] No VIF found with MAC fa:16:3e:97:d5:dc, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Updated VIF entry in instance network info cache for port f1b43dba-2876-48a4-8e38-59cc2428f26d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Updating instance_info_cache with network_info: [{"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.21", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ca081d-d901-4081-b440-230b46955e12 req-d5fe2a21-007b-4fcf-82b4-3e87fe43d8a3 service nova] Releasing lock "refresh_cache-d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Instance destroyed successfully.
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.objects.instance [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'resources' on Instance uuid d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:04:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1022655961',display_name='tempest-AttachVolumeNegativeTest-server-1022655961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1022655961',id=14,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHjVedx8H+Jzjn6MJWzm3wmkqQnk7EWcncuayyG511jDCQX5BZ54ccAtfLdPQHV0D35qFXK9Lyc6BrTVc+22+f9EiKFNImovK7NwceVtMH1E16bbf6XHl48dyukuF6VYw==',key_name='tempest-keypair-266849130',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:04:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-4wy89g2k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:04:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "address": "fa:16:3e:e7:a8:f5", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1b43dba-28", "ovs_interfaceid": "f1b43dba-2876-48a4-8e38-59cc2428f26d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a8:f5,bridge_name='br-int',has_traffic_filtering=True,id=f1b43dba-2876-48a4-8e38-59cc2428f26d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b43dba-28') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG os_vif [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a8:f5,bridge_name='br-int',has_traffic_filtering=True,id=f1b43dba-2876-48a4-8e38-59cc2428f26d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b43dba-28') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1b43dba-28, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79a73c98-b19e-411a-8e6c-48abdaf0c1c7) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: INFO os_vif [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:a8:f5,bridge_name='br-int',has_traffic_filtering=True,id=f1b43dba-2876-48a4-8e38-59cc2428f26d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1b43dba-28')
Nov 14 08:06:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Deleting instance files /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea_del
Nov 14 08:06:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Deletion of /opt/stack/data/nova/instances/d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea_del complete
Nov 14 08:06:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Starting migrate_disk_and_power_off {{(pid=75305) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-64ed8117-fcbe-41b5-a5fe-c4f0a635c03f req-08027f52-0318-4215-9dbe-d77b26699695 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-64ed8117-fcbe-41b5-a5fe-c4f0a635c03f req-08027f52-0318-4215-9dbe-d77b26699695 service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-64ed8117-fcbe-41b5-a5fe-c4f0a635c03f req-08027f52-0318-4215-9dbe-d77b26699695 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-64ed8117-fcbe-41b5-a5fe-c4f0a635c03f req-08027f52-0318-4215-9dbe-d77b26699695 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-64ed8117-fcbe-41b5-a5fe-c4f0a635c03f req-08027f52-0318-4215-9dbe-d77b26699695 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:18 user nova-compute[75305]: WARNING nova.compute.manager [req-64ed8117-fcbe-41b5-a5fe-c4f0a635c03f req-08027f52-0318-4215-9dbe-d77b26699695 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state active and task_state resize_migrating.
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-dc0d9c35-2a52-4a24-ad2b-465085b96fa6 req-6a12401f-c5b3-4a54-91c3-e0deb1e67081 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-unplugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dc0d9c35-2a52-4a24-ad2b-465085b96fa6 req-6a12401f-c5b3-4a54-91c3-e0deb1e67081 service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dc0d9c35-2a52-4a24-ad2b-465085b96fa6 req-6a12401f-c5b3-4a54-91c3-e0deb1e67081 service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dc0d9c35-2a52-4a24-ad2b-465085b96fa6 req-6a12401f-c5b3-4a54-91c3-e0deb1e67081 service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-dc0d9c35-2a52-4a24-ad2b-465085b96fa6 req-6a12401f-c5b3-4a54-91c3-e0deb1e67081 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-unplugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-dc0d9c35-2a52-4a24-ad2b-465085b96fa6 req-6a12401f-c5b3-4a54-91c3-e0deb1e67081 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-unplugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:06:18 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance destroyed successfully.
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1568265897-network", "vif_mac": "fa:16:3e:ed:e6:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1568265897-network", "vif_mac": "fa:16:3e:ed:e6:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG os_vif [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f99886b-aa, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88f4841b-2862-4f6d-896b-3a240fac90c8) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:18 user nova-compute[75305]: INFO os_vif [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa')
Nov 14 08:06:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:19 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bac3e4-6f4a-4d37-a7c9-cfede8a644e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:06:19 user nova-compute[75305]: No targets found.
Nov 14 08:06:19 user nova-compute[75305]: iSNS:
Nov 14 08:06:19 user nova-compute[75305]: No targets found.
Nov 14 08:06:19 user nova-compute[75305]: STATIC:
Nov 14 08:06:19 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:06:19 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:06:19 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:06:19 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:06:19 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:06:19 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:06:19 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:06:19 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:06:19 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:06:19 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d
Nov 14 08:06:19 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:06:19 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:06:19 user nova-compute[75305]: FIRMWARE:
Nov 14 08:06:19 user nova-compute[75305]: No targets found.
Nov 14 08:06:19 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:06:19 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:06:19 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[217aafb7-36aa-4efa-8411-cc618d2c53bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e42500-01bc-4340-9240-a4adc4ea4cee]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:19 user nova-compute[75305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:19 user nova-compute[75305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)
Nov 14 08:06:19 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:19 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:19 user nova-compute[75305]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:19 user nova-compute[75305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)
Nov 14 08:06:19 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:19 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4434d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b61e055-901f-404e-8849-d7b85bf92615]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb08f5e-19ff-43ef-9c80-7441e4a0f393]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd55058-3f79-422b-b5fb-a20aea29423e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.097s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d6a90a-e4a5-4dcf-b89d-64b9401a7b86]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-71a0dc77-e861-4f7f-b02d-9ebacbcb66df req-7f61a66a-3821-4ebd-85f1-1a4f79fcf738 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-71a0dc77-e861-4f7f-b02d-9ebacbcb66df req-7f61a66a-3821-4ebd-85f1-1a4f79fcf738 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-71a0dc77-e861-4f7f-b02d-9ebacbcb66df req-7f61a66a-3821-4ebd-85f1-1a4f79fcf738 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-71a0dc77-e861-4f7f-b02d-9ebacbcb66df req-7f61a66a-3821-4ebd-85f1-1a4f79fcf738 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-71a0dc77-e861-4f7f-b02d-9ebacbcb66df req-7f61a66a-3821-4ebd-85f1-1a4f79fcf738 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:19 user nova-compute[75305]: WARNING nova.compute.manager [req-71a0dc77-e861-4f7f-b02d-9ebacbcb66df req-7f61a66a-3821-4ebd-85f1-1a4f79fcf738 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state active and task_state rescuing.
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d81508-a78f-4f3a-8235-e2e90bc7a482]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba312a03-05fb-4641-a34e-14bfeebf5937]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]
Nov 14 08:06:19 user nova-compute[75305]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.
Nov 14 08:06:19 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e3df2-da05-4d05-aba4-4308b8642ceb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.480s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== disconnect_volume: return (483ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: INFO nova.compute.manager [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Took 3.50 seconds to destroy the instance on the hypervisor.
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace_resize/disk /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:06:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-bf21902a-accd-4091-9f7e-30a321a366a4 req-b1b6d127-f733-4d14-b689-9147073089d5 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bf21902a-accd-4091-9f7e-30a321a366a4 req-b1b6d127-f733-4d14-b689-9147073089d5 service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bf21902a-accd-4091-9f7e-30a321a366a4 req-b1b6d127-f733-4d14-b689-9147073089d5 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bf21902a-accd-4091-9f7e-30a321a366a4 req-b1b6d127-f733-4d14-b689-9147073089d5 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-bf21902a-accd-4091-9f7e-30a321a366a4 req-b1b6d127-f733-4d14-b689-9147073089d5 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:20 user nova-compute[75305]: WARNING nova.compute.manager [req-bf21902a-accd-4091-9f7e-30a321a366a4 req-b1b6d127-f733-4d14-b689-9147073089d5 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state active and task_state resize_migrating.
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:20 user nova-compute[75305]: WARNING nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received unexpected event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with vm_state active and task_state deleting.
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:20 user nova-compute[75305]: WARNING nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received unexpected event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with vm_state active and task_state deleting.
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:20 user nova-compute[75305]: WARNING nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received unexpected event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with vm_state active and task_state deleting.
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-unplugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-unplugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-7898a3b1-80e9-4e91-9c4c-5a32f7174e84 req-8a275def-674d-44ea-8524-aa778dfe42cc service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-unplugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Error from libvirt while getting description of instance-0000000e: [Error Code 42] Domain not found: no domain with matching uuid 'd6474ac0-fcb9-4244-a2c2-d08c35bdd8ea' (instance-0000000e): libvirt.libvirtError: Domain not found: no domain with matching uuid 'd6474ac0-fcb9-4244-a2c2-d08c35bdd8ea' (instance-0000000e)
Nov 14 08:06:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "cp -r /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace_resize/disk /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk" returned: 0 in 0.559s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace_resize/disk.info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk.info {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-c02eab15-a8ea-4bcf-86ef-c1896978676a req-65d74a18-cc48-425a-989e-f1827b685f1a service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c02eab15-a8ea-4bcf-86ef-c1896978676a req-65d74a18-cc48-425a-989e-f1827b685f1a service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c02eab15-a8ea-4bcf-86ef-c1896978676a req-65d74a18-cc48-425a-989e-f1827b685f1a service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c02eab15-a8ea-4bcf-86ef-c1896978676a req-65d74a18-cc48-425a-989e-f1827b685f1a service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-c02eab15-a8ea-4bcf-86ef-c1896978676a req-65d74a18-cc48-425a-989e-f1827b685f1a service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:22 user nova-compute[75305]: WARNING nova.compute.manager [req-c02eab15-a8ea-4bcf-86ef-c1896978676a req-65d74a18-cc48-425a-989e-f1827b685f1a service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state active and task_state rescuing.
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.manager [None req-35e427bc-9c3f-440b-a6ae-3fefee7736b4 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "cp -r /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace_resize/disk.info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk.info" returned: 0 in 0.074s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:22 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Took 2.56 seconds to deallocate network for instance.
Nov 14 08:06:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8178MB free_disk=25.47015380859375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-cb71fdbe-dad5-4510-8ccb-5a4fa869d74c req-def3d3af-f24a-47d8-899e-bec0c4317d90 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-deleted-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Applying migration context for instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace as it has an incoming, in-progress migration 01ed8c82-3f87-450b-93ba-f2be8e98d473. Migration status is migrating {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 08:06:22 user nova-compute[75305]: INFO nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating resource usage from migration 01ed8c82-3f87-450b-93ba-f2be8e98d473
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-98b82409-287d-4050-9d37-009ceb386436 req-c3697787-3583-4c92-804b-1e9748a85433 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-98b82409-287d-4050-9d37-009ceb386436 req-c3697787-3583-4c92-804b-1e9748a85433 service nova] Acquiring lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-98b82409-287d-4050-9d37-009ceb386436 req-c3697787-3583-4c92-804b-1e9748a85433 service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-98b82409-287d-4050-9d37-009ceb386436 req-c3697787-3583-4c92-804b-1e9748a85433 service nova] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-98b82409-287d-4050-9d37-009ceb386436 req-c3697787-3583-4c92-804b-1e9748a85433 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] No waiting events found dispatching network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:22 user nova-compute[75305]: WARNING nova.compute.manager [req-98b82409-287d-4050-9d37-009ceb386436 req-c3697787-3583-4c92-804b-1e9748a85433 service nova] [instance: d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea] Received unexpected event network-vif-plugged-f1b43dba-2876-48a4-8e38-59cc2428f26d for instance with vm_state deleted and task_state None.
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5959dc8-a417-4528-9f03-3951186c2315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6dd11b5a-6147-4cd1-965a-19f75a091198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Migration 01ed8c82-3f87-450b-93ba-f2be8e98d473 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:06:22 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.890s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.672s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:23 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Deleted allocations for instance d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea
Nov 14 08:06:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dfd60dc9-2b62-4bf8-9c5d-1b0f1cf87f50 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "d6474ac0-fcb9-4244-a2c2-d08c35bdd8ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.708s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Port 9f99886b-aaf5-4e84-a5d2-2e74015f4386 binding to destination host user is already ACTIVE {{(pid=75305) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 08:06:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG os_brick.utils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be03e6c8-7152-4f98-a28e-90f707da2922]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db15ab1-a647-43f9-a2a2-1eafeb82e8de]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f6cf49-ce72-4254-83e8-eb34cdafdbe0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d406d992-2e53-4340-924c-4a72c893d489]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:06:25 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecde9da8-0b08-4541-a32e-97c9b4b0e933]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG os_brick.utils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updating instance_info_cache with network_info: [{"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-6dd11b5a-6147-4cd1-965a-19f75a091198" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:06:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:06:27 user nova-compute[75305]: INFO nova.compute.claims [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Claim successful on node user
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:06:27 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:06:27 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Creating image(s)
Nov 14 08:06:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "/opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "/opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "/opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG nova.policy [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c331473d0aef488fa1dd92543749f50e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45dc68f3d5354a06905843816164c441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.280s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.342s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk 1073741824" returned: 0 in 0.051s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.402s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Cannot resize image /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Ensure instance console log exists: /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:29 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Successfully created port: a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Successfully updated port: a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquired lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-changed-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Refreshing instance network info cache due to event network-changed-a88fde8c-e91d-42b0-b599-801eec3ea513. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] Acquiring lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updating instance_info_cache with network_info: [{"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Releasing lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Instance network_info: |[{"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] Acquired lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Refreshing network info cache for port a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Start _get_guest_xml network_info=[{"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:06:30 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:30 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:06:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2101402344',display_name='tempest-VolumesSnapshotTestJSON-instance-2101402344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2101402344',id=16,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbLSjT+vHB+y2vliaLvXAgWM4/CuaAhpf4RY53BnnqPoKdyshX8a+T9SDTHB9pJHJtV75tDW1yHlRqmoz47ItwKPu00wURhrP76S+HO7lxMYZABT0CZ3T7LIiOpLWQxA==',key_name='tempest-keypair-1415231870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45dc68f3d5354a06905843816164c441',ramdisk_id='',reservation_id='r-vde9bdcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-109737474',owner_user_name='tempest-VolumesSnapshotTestJSON-109737474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c331473d0aef488fa1dd92543749f50e',uuid=75e8c85d-2a8b-4eef-80ab-e0a76998509d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converting VIF {"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:42:00,bridge_name='br-int',has_traffic_filtering=True,id=a88fde8c-e91d-42b0-b599-801eec3ea513,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88fde8c-e9') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.objects.instance [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'pci_devices' on Instance uuid 75e8c85d-2a8b-4eef-80ab-e0a76998509d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:06:31 user nova-compute[75305]:   <uuid>75e8c85d-2a8b-4eef-80ab-e0a76998509d</uuid>
Nov 14 08:06:31 user nova-compute[75305]:   <name>instance-00000010</name>
Nov 14 08:06:31 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:06:31 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:06:31 user nova-compute[75305]:   <metadata>
Nov 14 08:06:31 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:06:31 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:06:31 user nova-compute[75305]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2101402344</nova:name>
Nov 14 08:06:31 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:06:30</nova:creationTime>
Nov 14 08:06:31 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:06:31 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:06:31 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:06:31 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:06:31 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:06:31 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:06:31 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:06:31 user nova-compute[75305]:       <nova:owner>
Nov 14 08:06:31 user nova-compute[75305]:         <nova:user uuid="c331473d0aef488fa1dd92543749f50e">tempest-VolumesSnapshotTestJSON-109737474-project-member</nova:user>
Nov 14 08:06:31 user nova-compute[75305]:         <nova:project uuid="45dc68f3d5354a06905843816164c441">tempest-VolumesSnapshotTestJSON-109737474</nova:project>
Nov 14 08:06:31 user nova-compute[75305]:       </nova:owner>
Nov 14 08:06:31 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:06:31 user nova-compute[75305]:       <nova:ports>
Nov 14 08:06:31 user nova-compute[75305]:         <nova:port uuid="a88fde8c-e91d-42b0-b599-801eec3ea513">
Nov 14 08:06:31 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 08:06:31 user nova-compute[75305]:         </nova:port>
Nov 14 08:06:31 user nova-compute[75305]:       </nova:ports>
Nov 14 08:06:31 user nova-compute[75305]:     </nova:instance>
Nov 14 08:06:31 user nova-compute[75305]:   </metadata>
Nov 14 08:06:31 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:06:31 user nova-compute[75305]:     <system>
Nov 14 08:06:31 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:06:31 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:06:31 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:06:31 user nova-compute[75305]:       <entry name="serial">75e8c85d-2a8b-4eef-80ab-e0a76998509d</entry>
Nov 14 08:06:31 user nova-compute[75305]:       <entry name="uuid">75e8c85d-2a8b-4eef-80ab-e0a76998509d</entry>
Nov 14 08:06:31 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:06:31 user nova-compute[75305]:     </system>
Nov 14 08:06:31 user nova-compute[75305]:   </sysinfo>
Nov 14 08:06:31 user nova-compute[75305]:   <os>
Nov 14 08:06:31 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:06:31 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:06:31 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:06:31 user nova-compute[75305]:   </os>
Nov 14 08:06:31 user nova-compute[75305]:   <features>
Nov 14 08:06:31 user nova-compute[75305]:     <acpi/>
Nov 14 08:06:31 user nova-compute[75305]:     <apic/>
Nov 14 08:06:31 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:06:31 user nova-compute[75305]:   </features>
Nov 14 08:06:31 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:06:31 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:06:31 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:06:31 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:06:31 user nova-compute[75305]:   </clock>
Nov 14 08:06:31 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:06:31 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:06:31 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:06:31 user nova-compute[75305]:   </cpu>
Nov 14 08:06:31 user nova-compute[75305]:   <devices>
Nov 14 08:06:31 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:06:31 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:06:31 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk"/>
Nov 14 08:06:31 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:06:31 user nova-compute[75305]:     </disk>
Nov 14 08:06:31 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:06:31 user nova-compute[75305]:       <mac address="fa:16:3e:53:42:00"/>
Nov 14 08:06:31 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:31 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:06:31 user nova-compute[75305]:       <target dev="tapa88fde8c-e9"/>
Nov 14 08:06:31 user nova-compute[75305]:     </interface>
Nov 14 08:06:31 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:06:31 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/console.log" append="off"/>
Nov 14 08:06:31 user nova-compute[75305]:     </serial>
Nov 14 08:06:31 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:06:31 user nova-compute[75305]:     <video>
Nov 14 08:06:31 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:31 user nova-compute[75305]:     </video>
Nov 14 08:06:31 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:06:31 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:06:31 user nova-compute[75305]:     </rng>
Nov 14 08:06:31 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:06:31 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:06:31 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:06:31 user nova-compute[75305]:     </memballoon>
Nov 14 08:06:31 user nova-compute[75305]:   </devices>
Nov 14 08:06:31 user nova-compute[75305]: </domain>
Nov 14 08:06:31 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2101402344',display_name='tempest-VolumesSnapshotTestJSON-instance-2101402344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2101402344',id=16,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbLSjT+vHB+y2vliaLvXAgWM4/CuaAhpf4RY53BnnqPoKdyshX8a+T9SDTHB9pJHJtV75tDW1yHlRqmoz47ItwKPu00wURhrP76S+HO7lxMYZABT0CZ3T7LIiOpLWQxA==',key_name='tempest-keypair-1415231870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='45dc68f3d5354a06905843816164c441',ramdisk_id='',reservation_id='r-vde9bdcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-109737474',owner_user_name='tempest-VolumesSnapshotTestJSON-109737474-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c331473d0aef488fa1dd92543749f50e',uuid=75e8c85d-2a8b-4eef-80ab-e0a76998509d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converting VIF {"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:42:00,bridge_name='br-int',has_traffic_filtering=True,id=a88fde8c-e91d-42b0-b599-801eec3ea513,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88fde8c-e9') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG os_vif [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:42:00,bridge_name='br-int',has_traffic_filtering=True,id=a88fde8c-e91d-42b0-b599-801eec3ea513,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88fde8c-e9') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ced5e059-5951-5a79-ae7c-af428c8119ae', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa88fde8c-e9, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa88fde8c-e9, col_values=(('qos', UUID('958c5637-fd18-49e8-b9c1-587225cc34f6')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa88fde8c-e9, col_values=(('external_ids', {'iface-id': 'a88fde8c-e91d-42b0-b599-801eec3ea513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:42:00', 'vm-uuid': '75e8c85d-2a8b-4eef-80ab-e0a76998509d'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:31 user nova-compute[75305]: INFO os_vif [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:42:00,bridge_name='br-int',has_traffic_filtering=True,id=a88fde8c-e91d-42b0-b599-801eec3ea513,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88fde8c-e9')
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No VIF found with MAC fa:16:3e:53:42:00, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Starting finish_migration {{(pid=75305) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:06:31 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Creating image(s)
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.215s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk. size=21474836480 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updated VIF entry in instance network info cache for port a88fde8c-e91d-42b0-b599-801eec3ea513. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updating instance_info_cache with network_info: [{"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ae0c9e-0eff-4a32-b8c6-cd64e4716a6f req-584d89e1-c14b-442d-8468-15a96801d4ab service nova] Releasing lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:06:31 user nova-compute[75305]: INFO nova.compute.claims [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Claim successful on node user
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk 21474836480 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk 21474836480" returned: 0 in 0.098s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Ensure instance console log exists: /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Start _get_guest_xml network_info=[{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1568265897-network", "vif_mac": "fa:16:3e:ed:e6:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'e77ba1e8-7853-4537-b76c-c8f68d2afadd', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace', 'attached_at': '2023-11-14T08:06:31.000000', 'detached_at': '', 'volume_id': '47c805e5-5129-493e-94e7-1fd4a5235d33', 'serial': '47c805e5-5129-493e-94e7-1fd4a5235d33'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:06:32 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:32 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:06:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:06:32 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd2eaaa-e6b3-416e-8ed8-9ce59d5a8522]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:06:32 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc75103-db18-4907-8a0e-0a3561f12b43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33] added
Nov 14 08:06:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa78754-81d4-47e5-b788-bd0097dbf681]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b64fcd-41b7-4bff-afe3-4d248a8a804c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFYybEUk {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFYybEUk" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a26ee48-5a1d-4c0d-abc2-fb686ee1c162]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFYybEUk'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d0f25-5ec2-4bb3-aadb-618a5b9d0e4a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a0e513-1536-46e6-8303-58b095fe8223]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fc8a69-ef32-49ca-9de3-4782b24e2d02 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fc8a69-ef32-49ca-9de3-4782b24e2d02 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fc8a69-ef32-49ca-9de3-4782b24e2d02 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.684s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea10c27-2814-4d07-b73a-96f551042956]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]
Nov 14 08:06:32 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.
Nov 14 08:06:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb14fb55-191b-4ab6-9d26-00978b9b6ede]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25ed4cf-30a9-4262-90f7-d440734af3dc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fc8a69-ef32-49ca-9de3-4782b24e2d02 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fc8a69-ef32-49ca-9de3-4782b24e2d02 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2efa9550-aa47-4002-9221-f5a5d0b5723d (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23fc8a69-ef32-49ca-9de3-4782b24e2d02 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:06:32 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:06:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[94945fa0-beea-4312-9bda-4c8f4da29ecc]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:06:32 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.policy [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01aef878d55548b38330a5dee6631c37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08d64a4402634675b6565ef1dd2e11d2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:06:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:06:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Creating image(s)
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "/opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "/opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "/opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.207s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== connect_volume: return (1510ms) {'type': 'block', 'scsi_wwn': '26430653834353534', 'path': '/dev/sde'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430653834353534', 'path': '/dev/sde'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-2e308cf3-d156-4d49-994a-0925ace9b268 req-eaf2dee7-4ee9-41ed-9c4f-80a870e2acc6 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2e308cf3-d156-4d49-994a-0925ace9b268 req-eaf2dee7-4ee9-41ed-9c4f-80a870e2acc6 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2e308cf3-d156-4d49-994a-0925ace9b268 req-eaf2dee7-4ee9-41ed-9c4f-80a870e2acc6 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2e308cf3-d156-4d49-994a-0925ace9b268 req-eaf2dee7-4ee9-41ed-9c4f-80a870e2acc6 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-2e308cf3-d156-4d49-994a-0925ace9b268 req-eaf2dee7-4ee9-41ed-9c4f-80a870e2acc6 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:33 user nova-compute[75305]: WARNING nova.compute.manager [req-2e308cf3-d156-4d49-994a-0925ace9b268 req-eaf2dee7-4ee9-41ed-9c4f-80a870e2acc6 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received unexpected event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with vm_state building and task_state spawning.
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1568265897-network", "vif_mac": "fa:16:3e:ed:e6:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1568265897-network", "vif_mac": "fa:16:3e:ed:e6:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:06:33 user nova-compute[75305]:   <uuid>ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</uuid>
Nov 14 08:06:33 user nova-compute[75305]:   <name>instance-00000005</name>
Nov 14 08:06:33 user nova-compute[75305]:   <memory>2097152</memory>
Nov 14 08:06:33 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:06:33 user nova-compute[75305]:   <metadata>
Nov 14 08:06:33 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:06:33 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:06:33 user nova-compute[75305]:       <nova:name>tempest-ServerActionsTestOtherB-server-559180561</nova:name>
Nov 14 08:06:33 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:06:32</nova:creationTime>
Nov 14 08:06:33 user nova-compute[75305]:       <nova:flavor name="m1.small">
Nov 14 08:06:33 user nova-compute[75305]:         <nova:memory>2048</nova:memory>
Nov 14 08:06:33 user nova-compute[75305]:         <nova:disk>20</nova:disk>
Nov 14 08:06:33 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:06:33 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:06:33 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:06:33 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:06:33 user nova-compute[75305]:       <nova:owner>
Nov 14 08:06:33 user nova-compute[75305]:         <nova:user uuid="7dda8620115b4ad5a5acc0c811ef44ee">tempest-ServerActionsTestOtherB-1488485775-project-member</nova:user>
Nov 14 08:06:33 user nova-compute[75305]:         <nova:project uuid="cd8b5236976e4be48b494cdbc69015b4">tempest-ServerActionsTestOtherB-1488485775</nova:project>
Nov 14 08:06:33 user nova-compute[75305]:       </nova:owner>
Nov 14 08:06:33 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:06:33 user nova-compute[75305]:       <nova:ports>
Nov 14 08:06:33 user nova-compute[75305]:         <nova:port uuid="9f99886b-aaf5-4e84-a5d2-2e74015f4386">
Nov 14 08:06:33 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 08:06:33 user nova-compute[75305]:         </nova:port>
Nov 14 08:06:33 user nova-compute[75305]:       </nova:ports>
Nov 14 08:06:33 user nova-compute[75305]:     </nova:instance>
Nov 14 08:06:33 user nova-compute[75305]:   </metadata>
Nov 14 08:06:33 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:06:33 user nova-compute[75305]:     <system>
Nov 14 08:06:33 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:06:33 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:06:33 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:06:33 user nova-compute[75305]:       <entry name="serial">ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</entry>
Nov 14 08:06:33 user nova-compute[75305]:       <entry name="uuid">ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</entry>
Nov 14 08:06:33 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:06:33 user nova-compute[75305]:     </system>
Nov 14 08:06:33 user nova-compute[75305]:   </sysinfo>
Nov 14 08:06:33 user nova-compute[75305]:   <os>
Nov 14 08:06:33 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:06:33 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:06:33 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:06:33 user nova-compute[75305]:   </os>
Nov 14 08:06:33 user nova-compute[75305]:   <features>
Nov 14 08:06:33 user nova-compute[75305]:     <acpi/>
Nov 14 08:06:33 user nova-compute[75305]:     <apic/>
Nov 14 08:06:33 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:06:33 user nova-compute[75305]:   </features>
Nov 14 08:06:33 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:06:33 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:06:33 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:06:33 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:06:33 user nova-compute[75305]:   </clock>
Nov 14 08:06:33 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:06:33 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:06:33 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:06:33 user nova-compute[75305]:   </cpu>
Nov 14 08:06:33 user nova-compute[75305]:   <devices>
Nov 14 08:06:33 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:06:33 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:06:33 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk"/>
Nov 14 08:06:33 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:06:33 user nova-compute[75305]:     </disk>
Nov 14 08:06:33 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:06:33 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:06:33 user nova-compute[75305]:       <source dev="/dev/sde"/>
Nov 14 08:06:33 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:06:33 user nova-compute[75305]:       <serial>47c805e5-5129-493e-94e7-1fd4a5235d33</serial>
Nov 14 08:06:33 user nova-compute[75305]:     </disk>
Nov 14 08:06:33 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:06:33 user nova-compute[75305]:       <mac address="fa:16:3e:ed:e6:07"/>
Nov 14 08:06:33 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:33 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:06:33 user nova-compute[75305]:       <target dev="tap9f99886b-aa"/>
Nov 14 08:06:33 user nova-compute[75305]:     </interface>
Nov 14 08:06:33 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:06:33 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/console.log" append="off"/>
Nov 14 08:06:33 user nova-compute[75305]:     </serial>
Nov 14 08:06:33 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:06:33 user nova-compute[75305]:     <video>
Nov 14 08:06:33 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:33 user nova-compute[75305]:     </video>
Nov 14 08:06:33 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:06:33 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:06:33 user nova-compute[75305]:     </rng>
Nov 14 08:06:33 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:06:33 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:06:33 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:06:33 user nova-compute[75305]:     </memballoon>
Nov 14 08:06:33 user nova-compute[75305]:   </devices>
Nov 14 08:06:33 user nova-compute[75305]: </domain>
Nov 14 08:06:33 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1568265897-network", "vif_mac": "fa:16:3e:ed:e6:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1568265897-network", "vif_mac": "fa:16:3e:ed:e6:07"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG os_vif [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '939d6e4f-8c81-5e97-aec7-8ed78d24a5cf', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.294s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f99886b-aa, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f99886b-aa, col_values=(('qos', UUID('e5b7568c-12ae-4265-b405-8c222cab209b')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f99886b-aa, col_values=(('external_ids', {'iface-id': '9f99886b-aaf5-4e84-a5d2-2e74015f4386', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:e6:07', 'vm-uuid': 'ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk 1073741824" returned: 0 in 0.097s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.400s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: INFO os_vif [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa')
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] No VIF found with MAC fa:16:3e:ed:e6:07, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.245s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Cannot resize image /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Ensure instance console log exists: /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Successfully created port: 9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:06:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Successfully updated port: 9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquired lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:06:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Instance spawned successfully.
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:35 user nova-compute[75305]: WARNING nova.compute.manager [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received unexpected event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with vm_state building and task_state spawning.
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-changed-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Refreshing instance network info cache due to event network-changed-9b473587-96aa-487c-b433-ec95b036b9aa. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] Acquiring lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Updating instance_info_cache with network_info: [{"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Releasing lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Instance network_info: |[{"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] Acquired lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Refreshing network info cache for port 9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Start _get_guest_xml network_info=[{"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:06:35 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:35 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:06:35 user nova-compute[75305]: INFO nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Took 7.99 seconds to spawn the instance on the hypervisor.
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:06:35 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-781466061',display_name='tempest-TestVolumeSwap-server-781466061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-781466061',id=17,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVWkKH/9GiYB992LOd9NryAwt81fBbe4PvtCeg159g62rbWmxcBE2PeJSUMDOZ/kFGfbTnKMt6uHsQhJOALCnRSg1NhJsUq40OfHlwRzKkNXWI7pjkrmldR4k64Hp9ESw==',key_name='tempest-keypair-814636690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08d64a4402634675b6565ef1dd2e11d2',ramdisk_id='',reservation_id='r-4r80knhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1450931470',owner_user_name='tempest-TestVolumeSwap-1450931470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01aef878d55548b38330a5dee6631c37',uuid=e70bba44-e95d-4685-b5ae-18ea4ff42d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Converting VIF {"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:73:1c,bridge_name='br-int',has_traffic_filtering=True,id=9b473587-96aa-487c-b433-ec95b036b9aa,network=Network(09be2324-8fa3-492a-8bc8-217f49c74a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b473587-96') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lazy-loading 'pci_devices' on Instance uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:06:36 user nova-compute[75305]:   <uuid>e70bba44-e95d-4685-b5ae-18ea4ff42d21</uuid>
Nov 14 08:06:36 user nova-compute[75305]:   <name>instance-00000011</name>
Nov 14 08:06:36 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:06:36 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:06:36 user nova-compute[75305]:   <metadata>
Nov 14 08:06:36 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:06:36 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:06:36 user nova-compute[75305]:       <nova:name>tempest-TestVolumeSwap-server-781466061</nova:name>
Nov 14 08:06:36 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:06:35</nova:creationTime>
Nov 14 08:06:36 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:06:36 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:06:36 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:06:36 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:06:36 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:06:36 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:06:36 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:06:36 user nova-compute[75305]:       <nova:owner>
Nov 14 08:06:36 user nova-compute[75305]:         <nova:user uuid="01aef878d55548b38330a5dee6631c37">tempest-TestVolumeSwap-1450931470-project-member</nova:user>
Nov 14 08:06:36 user nova-compute[75305]:         <nova:project uuid="08d64a4402634675b6565ef1dd2e11d2">tempest-TestVolumeSwap-1450931470</nova:project>
Nov 14 08:06:36 user nova-compute[75305]:       </nova:owner>
Nov 14 08:06:36 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:06:36 user nova-compute[75305]:       <nova:ports>
Nov 14 08:06:36 user nova-compute[75305]:         <nova:port uuid="9b473587-96aa-487c-b433-ec95b036b9aa">
Nov 14 08:06:36 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 08:06:36 user nova-compute[75305]:         </nova:port>
Nov 14 08:06:36 user nova-compute[75305]:       </nova:ports>
Nov 14 08:06:36 user nova-compute[75305]:     </nova:instance>
Nov 14 08:06:36 user nova-compute[75305]:   </metadata>
Nov 14 08:06:36 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:06:36 user nova-compute[75305]:     <system>
Nov 14 08:06:36 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:06:36 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:06:36 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:06:36 user nova-compute[75305]:       <entry name="serial">e70bba44-e95d-4685-b5ae-18ea4ff42d21</entry>
Nov 14 08:06:36 user nova-compute[75305]:       <entry name="uuid">e70bba44-e95d-4685-b5ae-18ea4ff42d21</entry>
Nov 14 08:06:36 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:06:36 user nova-compute[75305]:     </system>
Nov 14 08:06:36 user nova-compute[75305]:   </sysinfo>
Nov 14 08:06:36 user nova-compute[75305]:   <os>
Nov 14 08:06:36 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:06:36 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:06:36 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:06:36 user nova-compute[75305]:   </os>
Nov 14 08:06:36 user nova-compute[75305]:   <features>
Nov 14 08:06:36 user nova-compute[75305]:     <acpi/>
Nov 14 08:06:36 user nova-compute[75305]:     <apic/>
Nov 14 08:06:36 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:06:36 user nova-compute[75305]:   </features>
Nov 14 08:06:36 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:06:36 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:06:36 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:06:36 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:06:36 user nova-compute[75305]:   </clock>
Nov 14 08:06:36 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:06:36 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:06:36 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:06:36 user nova-compute[75305]:   </cpu>
Nov 14 08:06:36 user nova-compute[75305]:   <devices>
Nov 14 08:06:36 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:06:36 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:06:36 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk"/>
Nov 14 08:06:36 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:06:36 user nova-compute[75305]:     </disk>
Nov 14 08:06:36 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:06:36 user nova-compute[75305]:       <mac address="fa:16:3e:5e:73:1c"/>
Nov 14 08:06:36 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:36 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:06:36 user nova-compute[75305]:       <target dev="tap9b473587-96"/>
Nov 14 08:06:36 user nova-compute[75305]:     </interface>
Nov 14 08:06:36 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:06:36 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/console.log" append="off"/>
Nov 14 08:06:36 user nova-compute[75305]:     </serial>
Nov 14 08:06:36 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:06:36 user nova-compute[75305]:     <video>
Nov 14 08:06:36 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:36 user nova-compute[75305]:     </video>
Nov 14 08:06:36 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:06:36 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:06:36 user nova-compute[75305]:     </rng>
Nov 14 08:06:36 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:06:36 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:06:36 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:06:36 user nova-compute[75305]:     </memballoon>
Nov 14 08:06:36 user nova-compute[75305]:   </devices>
Nov 14 08:06:36 user nova-compute[75305]: </domain>
Nov 14 08:06:36 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-781466061',display_name='tempest-TestVolumeSwap-server-781466061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-781466061',id=17,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVWkKH/9GiYB992LOd9NryAwt81fBbe4PvtCeg159g62rbWmxcBE2PeJSUMDOZ/kFGfbTnKMt6uHsQhJOALCnRSg1NhJsUq40OfHlwRzKkNXWI7pjkrmldR4k64Hp9ESw==',key_name='tempest-keypair-814636690',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08d64a4402634675b6565ef1dd2e11d2',ramdisk_id='',reservation_id='r-4r80knhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1450931470',owner_user_name='tempest-TestVolumeSwap-1450931470-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01aef878d55548b38330a5dee6631c37',uuid=e70bba44-e95d-4685-b5ae-18ea4ff42d21,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Converting VIF {"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:73:1c,bridge_name='br-int',has_traffic_filtering=True,id=9b473587-96aa-487c-b433-ec95b036b9aa,network=Network(09be2324-8fa3-492a-8bc8-217f49c74a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b473587-96') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG os_vif [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:73:1c,bridge_name='br-int',has_traffic_filtering=True,id=9b473587-96aa-487c-b433-ec95b036b9aa,network=Network(09be2324-8fa3-492a-8bc8-217f49c74a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b473587-96') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f035ba0-1795-5abc-9af7-75b02b13347e', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b473587-96, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b473587-96, col_values=(('qos', UUID('693b8100-424d-4021-9444-7021679c8ba8')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b473587-96, col_values=(('external_ids', {'iface-id': '9b473587-96aa-487c-b433-ec95b036b9aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:73:1c', 'vm-uuid': 'e70bba44-e95d-4685-b5ae-18ea4ff42d21'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: INFO os_vif [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:73:1c,bridge_name='br-int',has_traffic_filtering=True,id=9b473587-96aa-487c-b433-ec95b036b9aa,network=Network(09be2324-8fa3-492a-8bc8-217f49c74a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b473587-96')
Nov 14 08:06:36 user nova-compute[75305]: INFO nova.compute.manager [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Took 9.17 seconds to build instance.
Nov 14 08:06:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bc8bde39-0e9b-41c0-afc4-89bc9c3b9fd1 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.303s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] No VIF found with MAC fa:16:3e:5e:73:1c, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:37 user nova-compute[75305]: DEBUG nova.network.neutron [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Updated VIF entry in instance network info cache for port 9b473587-96aa-487c-b433-ec95b036b9aa. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:06:37 user nova-compute[75305]: DEBUG nova.network.neutron [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Updating instance_info_cache with network_info: [{"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e9bce55-8dc3-4c46-8866-8c7a87e75c95 req-87804f4d-270c-4514-8c00-f98f7892cef6 service nova] Releasing lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG nova.compute.manager [req-a07d104a-ee79-4718-9113-17c31281c0f9 req-a9f0c4e4-b068-41ae-9e4b-69fd02a9edaa service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a07d104a-ee79-4718-9113-17c31281c0f9 req-a9f0c4e4-b068-41ae-9e4b-69fd02a9edaa service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a07d104a-ee79-4718-9113-17c31281c0f9 req-a9f0c4e4-b068-41ae-9e4b-69fd02a9edaa service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a07d104a-ee79-4718-9113-17c31281c0f9 req-a9f0c4e4-b068-41ae-9e4b-69fd02a9edaa service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG nova.compute.manager [req-a07d104a-ee79-4718-9113-17c31281c0f9 req-a9f0c4e4-b068-41ae-9e4b-69fd02a9edaa service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:38 user nova-compute[75305]: WARNING nova.compute.manager [req-a07d104a-ee79-4718-9113-17c31281c0f9 req-a9f0c4e4-b068-41ae-9e4b-69fd02a9edaa service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received unexpected event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with vm_state building and task_state spawning.
Nov 14 08:06:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:06:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance running successfully.
Nov 14 08:06:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Failed to set time: agent not configured {{(pid=75305) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bc998206-b399-4c56-b50a-2e620ce3b99d tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] finish_migration finished successfully. {{(pid=75305) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-be80fceb-fd36-4df1-b226-679f0c5c46bb req-2d8626d9-a003-49c5-9865-fc8fd1344fc4 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-be80fceb-fd36-4df1-b226-679f0c5c46bb req-2d8626d9-a003-49c5-9865-fc8fd1344fc4 service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-be80fceb-fd36-4df1-b226-679f0c5c46bb req-2d8626d9-a003-49c5-9865-fc8fd1344fc4 service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-be80fceb-fd36-4df1-b226-679f0c5c46bb req-2d8626d9-a003-49c5-9865-fc8fd1344fc4 service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-be80fceb-fd36-4df1-b226-679f0c5c46bb req-2d8626d9-a003-49c5-9865-fc8fd1344fc4 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:40 user nova-compute[75305]: WARNING nova.compute.manager [req-be80fceb-fd36-4df1-b226-679f0c5c46bb req-2d8626d9-a003-49c5-9865-fc8fd1344fc4 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received unexpected event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with vm_state building and task_state spawning.
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:06:40 user nova-compute[75305]: INFO nova.compute.claims [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Claim successful on node user
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-c7ad9fe1-d4e8-48c2-bdac-b047a2473894 req-aed26cee-7959-4c18-8322-4d55353159c7 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c7ad9fe1-d4e8-48c2-bdac-b047a2473894 req-aed26cee-7959-4c18-8322-4d55353159c7 service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c7ad9fe1-d4e8-48c2-bdac-b047a2473894 req-aed26cee-7959-4c18-8322-4d55353159c7 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c7ad9fe1-d4e8-48c2-bdac-b047a2473894 req-aed26cee-7959-4c18-8322-4d55353159c7 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-c7ad9fe1-d4e8-48c2-bdac-b047a2473894 req-aed26cee-7959-4c18-8322-4d55353159c7 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:40 user nova-compute[75305]: WARNING nova.compute.manager [req-c7ad9fe1-d4e8-48c2-bdac-b047a2473894 req-aed26cee-7959-4c18-8322-4d55353159c7 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state resized and task_state None.
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:06:40 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Instance spawned successfully.
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:40 user nova-compute[75305]: INFO nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Took 7.51 seconds to spawn the instance on the hypervisor.
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:06:40 user nova-compute[75305]: INFO nova.compute.manager [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Took 9.12 seconds to build instance.
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3799465a-c29a-4a52-8edf-2c94bdbc6697 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.318s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:06:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:06:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:06:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG nova.policy [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '084e1f8ee4db4391b2d545926f45e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be86f7bfa9f4566a035ca96314ac1c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:06:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Creating image(s)
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.196s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk 1073741824" returned: 0 in 0.073s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.255s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:06:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Cannot resize image /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Ensure instance console log exists: /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-01b8410d-82a4-4375-8ee3-a7f07eabef2c req-e4c889c0-ca72-4eda-a8ca-46c16dc0114b service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-01b8410d-82a4-4375-8ee3-a7f07eabef2c req-e4c889c0-ca72-4eda-a8ca-46c16dc0114b service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-01b8410d-82a4-4375-8ee3-a7f07eabef2c req-e4c889c0-ca72-4eda-a8ca-46c16dc0114b service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-01b8410d-82a4-4375-8ee3-a7f07eabef2c req-e4c889c0-ca72-4eda-a8ca-46c16dc0114b service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-01b8410d-82a4-4375-8ee3-a7f07eabef2c req-e4c889c0-ca72-4eda-a8ca-46c16dc0114b service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:42 user nova-compute[75305]: WARNING nova.compute.manager [req-01b8410d-82a4-4375-8ee3-a7f07eabef2c req-e4c889c0-ca72-4eda-a8ca-46c16dc0114b service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state resized and task_state None.
Nov 14 08:06:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Successfully created port: 2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:06:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG nova.network.neutron [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Successfully updated port: 2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquired lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG nova.network.neutron [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing instance network info cache due to event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] Acquiring lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:06:43 user nova-compute[75305]: DEBUG nova.network.neutron [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Releasing lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance network_info: |[{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] Acquired lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.neutron [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Start _get_guest_xml network_info=[{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:06:44 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:44 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-113716200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-113716200',id=18,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDoRF2EW+47Bp/aN3W1QZH6tyM1NlPXatd3hRlKIaElGDLN0se+vBXrBadawHdZo2kVdF6J1fpDCAGug/K7mO/BFgTr9VzotrFDcpPoWS/24a8nUL9bsxRSJuRfbdhug==',key_name='tempest-keypair-146649035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-obbnhka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=c837ffe0-c080-444e-a327-a7781f6d49bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'pci_devices' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:06:44 user nova-compute[75305]:   <uuid>c837ffe0-c080-444e-a327-a7781f6d49bc</uuid>
Nov 14 08:06:44 user nova-compute[75305]:   <name>instance-00000012</name>
Nov 14 08:06:44 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:06:44 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:06:44 user nova-compute[75305]:   <metadata>
Nov 14 08:06:44 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:06:44 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:06:44 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-113716200</nova:name>
Nov 14 08:06:44 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:06:44</nova:creationTime>
Nov 14 08:06:44 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:06:44 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:06:44 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:06:44 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:06:44 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:06:44 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:06:44 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:06:44 user nova-compute[75305]:       <nova:owner>
Nov 14 08:06:44 user nova-compute[75305]:         <nova:user uuid="084e1f8ee4db4391b2d545926f45e659">tempest-AttachVolumeShelveTestJSON-488426726-project-member</nova:user>
Nov 14 08:06:44 user nova-compute[75305]:         <nova:project uuid="7be86f7bfa9f4566a035ca96314ac1c7">tempest-AttachVolumeShelveTestJSON-488426726</nova:project>
Nov 14 08:06:44 user nova-compute[75305]:       </nova:owner>
Nov 14 08:06:44 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:06:44 user nova-compute[75305]:       <nova:ports>
Nov 14 08:06:44 user nova-compute[75305]:         <nova:port uuid="2fc26dc0-37ee-4285-bb22-ec1f1c206301">
Nov 14 08:06:44 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 08:06:44 user nova-compute[75305]:         </nova:port>
Nov 14 08:06:44 user nova-compute[75305]:       </nova:ports>
Nov 14 08:06:44 user nova-compute[75305]:     </nova:instance>
Nov 14 08:06:44 user nova-compute[75305]:   </metadata>
Nov 14 08:06:44 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:06:44 user nova-compute[75305]:     <system>
Nov 14 08:06:44 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:06:44 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:06:44 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:06:44 user nova-compute[75305]:       <entry name="serial">c837ffe0-c080-444e-a327-a7781f6d49bc</entry>
Nov 14 08:06:44 user nova-compute[75305]:       <entry name="uuid">c837ffe0-c080-444e-a327-a7781f6d49bc</entry>
Nov 14 08:06:44 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:06:44 user nova-compute[75305]:     </system>
Nov 14 08:06:44 user nova-compute[75305]:   </sysinfo>
Nov 14 08:06:44 user nova-compute[75305]:   <os>
Nov 14 08:06:44 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:06:44 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:06:44 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:06:44 user nova-compute[75305]:   </os>
Nov 14 08:06:44 user nova-compute[75305]:   <features>
Nov 14 08:06:44 user nova-compute[75305]:     <acpi/>
Nov 14 08:06:44 user nova-compute[75305]:     <apic/>
Nov 14 08:06:44 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:06:44 user nova-compute[75305]:   </features>
Nov 14 08:06:44 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:06:44 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:06:44 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:06:44 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:06:44 user nova-compute[75305]:   </clock>
Nov 14 08:06:44 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:06:44 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:06:44 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:06:44 user nova-compute[75305]:   </cpu>
Nov 14 08:06:44 user nova-compute[75305]:   <devices>
Nov 14 08:06:44 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:06:44 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:06:44 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk"/>
Nov 14 08:06:44 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:06:44 user nova-compute[75305]:     </disk>
Nov 14 08:06:44 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:06:44 user nova-compute[75305]:       <mac address="fa:16:3e:bb:f4:55"/>
Nov 14 08:06:44 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:44 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:06:44 user nova-compute[75305]:       <target dev="tap2fc26dc0-37"/>
Nov 14 08:06:44 user nova-compute[75305]:     </interface>
Nov 14 08:06:44 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:06:44 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/console.log" append="off"/>
Nov 14 08:06:44 user nova-compute[75305]:     </serial>
Nov 14 08:06:44 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:06:44 user nova-compute[75305]:     <video>
Nov 14 08:06:44 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:06:44 user nova-compute[75305]:     </video>
Nov 14 08:06:44 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:06:44 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:06:44 user nova-compute[75305]:     </rng>
Nov 14 08:06:44 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:06:44 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:06:44 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:06:44 user nova-compute[75305]:     </memballoon>
Nov 14 08:06:44 user nova-compute[75305]:   </devices>
Nov 14 08:06:44 user nova-compute[75305]: </domain>
Nov 14 08:06:44 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-113716200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-113716200',id=18,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDoRF2EW+47Bp/aN3W1QZH6tyM1NlPXatd3hRlKIaElGDLN0se+vBXrBadawHdZo2kVdF6J1fpDCAGug/K7mO/BFgTr9VzotrFDcpPoWS/24a8nUL9bsxRSJuRfbdhug==',key_name='tempest-keypair-146649035',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-obbnhka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=c837ffe0-c080-444e-a327-a7781f6d49bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG os_vif [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4229a917-74a6-5c31-ad67-ea28d01c482f', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fc26dc0-37, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2fc26dc0-37, col_values=(('qos', UUID('bcbc387f-28fe-4d14-b8f8-4b8c1e66b2fe')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2fc26dc0-37, col_values=(('external_ids', {'iface-id': '2fc26dc0-37ee-4285-bb22-ec1f1c206301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:f4:55', 'vm-uuid': 'c837ffe0-c080-444e-a327-a7781f6d49bc'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:44 user nova-compute[75305]: INFO os_vif [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37')
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No VIF found with MAC fa:16:3e:bb:f4:55, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.neutron [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updated VIF entry in instance network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG nova.network.neutron [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:06:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8d1ceb9b-4443-42c9-9fe0-4d1d0663a0bf req-7852a3d2-64e4-4dfa-a885-a7703d5a6dd4 service nova] Releasing lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:06:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-b7fa4e49-e607-486d-9b8d-22e142b91c2d req-cfb7cf84-7089-477c-b987-9960d7b43fab service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b7fa4e49-e607-486d-9b8d-22e142b91c2d req-cfb7cf84-7089-477c-b987-9960d7b43fab service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b7fa4e49-e607-486d-9b8d-22e142b91c2d req-cfb7cf84-7089-477c-b987-9960d7b43fab service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b7fa4e49-e607-486d-9b8d-22e142b91c2d req-cfb7cf84-7089-477c-b987-9960d7b43fab service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-b7fa4e49-e607-486d-9b8d-22e142b91c2d req-cfb7cf84-7089-477c-b987-9960d7b43fab service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:46 user nova-compute[75305]: WARNING nova.compute.manager [req-b7fa4e49-e607-486d-9b8d-22e142b91c2d req-cfb7cf84-7089-477c-b987-9960d7b43fab service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state building and task_state spawning.
Nov 14 08:06:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-b2d227ca-8959-4459-826b-b227afb9c464 req-50fd0794-b34c-4c0a-a940-28ce460581e8 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b2d227ca-8959-4459-826b-b227afb9c464 req-50fd0794-b34c-4c0a-a940-28ce460581e8 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b2d227ca-8959-4459-826b-b227afb9c464 req-50fd0794-b34c-4c0a-a940-28ce460581e8 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b2d227ca-8959-4459-826b-b227afb9c464 req-50fd0794-b34c-4c0a-a940-28ce460581e8 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-b2d227ca-8959-4459-826b-b227afb9c464 req-50fd0794-b34c-4c0a-a940-28ce460581e8 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:06:48 user nova-compute[75305]: WARNING nova.compute.manager [req-b2d227ca-8959-4459-826b-b227afb9c464 req-50fd0794-b34c-4c0a-a940-28ce460581e8 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state building and task_state spawning.
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:06:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance spawned successfully.
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:06:49 user nova-compute[75305]: INFO nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Took 7.86 seconds to spawn the instance on the hypervisor.
Nov 14 08:06:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:06:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:49 user nova-compute[75305]: INFO nova.compute.manager [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Took 8.98 seconds to build instance.
Nov 14 08:06:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-29e6d0c7-5b10-4cf7-8f59-cf16e7d49300 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.131s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:06:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:06:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:07:04 user nova-compute[75305]: INFO nova.compute.claims [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Claim successful on node user
Nov 14 08:07:04 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:07:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.policy [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16838539a9744332abe3e3e99c19e9fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2487b11b988248af93e1d2d2b7c450bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:07:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Creating image(s)
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "/opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "/opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.199s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk 1073741824" returned: 0 in 0.063s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:07:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Cannot resize image /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Ensure instance console log exists: /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Successfully created port: 1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:07:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:07 user nova-compute[75305]: INFO nova.compute.manager [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Detaching volume 78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:07:07 user nova-compute[75305]: INFO nova.virt.block_device [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Attempting to driver detach volume 78216012-bbe0-49ba-942f-885dd281d83b from mountpoint /dev/vdb
Nov 14 08:07:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Attempting to detach device vdb from instance 6dd11b5a-6147-4cd1-965a-19f75a091198 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:07:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:07:07 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:07:07 user nova-compute[75305]:   <source dev="/dev/sdh"/>
Nov 14 08:07:07 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:07:07 user nova-compute[75305]:   <serial>78216012-bbe0-49ba-942f-885dd281d83b</serial>
Nov 14 08:07:07 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:07:07 user nova-compute[75305]: </disk>
Nov 14 08:07:07 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:07:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully detached device vdb from instance 6dd11b5a-6147-4cd1-965a-19f75a091198 from the persistent domain config.
Nov 14 08:07:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6dd11b5a-6147-4cd1-965a-19f75a091198 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:07:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:07:07 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:07:07 user nova-compute[75305]:   <source dev="/dev/sdh"/>
Nov 14 08:07:07 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:07:07 user nova-compute[75305]:   <serial>78216012-bbe0-49ba-942f-885dd281d83b</serial>
Nov 14 08:07:07 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:07:07 user nova-compute[75305]: </disk>
Nov 14 08:07:07 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:07:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:07 user nova-compute[75305]: DEBUG nova.network.neutron [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Successfully updated port: 1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:07:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "refresh_cache-e1bef3aa-b56f-47e3-8ab2-cf7736787326" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquired lock "refresh_cache-e1bef3aa-b56f-47e3-8ab2-cf7736787326" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.neutron [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received event network-changed-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Refreshing instance network info cache due to event network-changed-1f5d7be0-4876-4391-9e2a-33b7a653b49b. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] Acquiring lock "refresh_cache-e1bef3aa-b56f-47e3-8ab2-cf7736787326" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.neutron [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6dd11b5a-6147-4cd1-965a-19f75a091198 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.neutron [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Updating instance_info_cache with network_info: [{"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Releasing lock "refresh_cache-e1bef3aa-b56f-47e3-8ab2-cf7736787326" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Instance network_info: |[{"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] Acquired lock "refresh_cache-e1bef3aa-b56f-47e3-8ab2-cf7736787326" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.neutron [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Refreshing network info cache for port 1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Start _get_guest_xml network_info=[{"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:07:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:08 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1078531263',display_name='tempest-DeleteServersTestJSON-server-1078531263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1078531263',id=19,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2487b11b988248af93e1d2d2b7c450bb',ramdisk_id='',reservation_id='r-3zvqvcte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-229895742',owner_user_name='tempest-DeleteServersTestJSON-229895742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:07:05Z,user_data=None,user_id='16838539a9744332abe3e3e99c19e9fb',uuid=e1bef3aa-b56f-47e3-8ab2-cf7736787326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Converting VIF {"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:69:31,bridge_name='br-int',has_traffic_filtering=True,id=1f5d7be0-4876-4391-9e2a-33b7a653b49b,network=Network(ae5a0424-0ef8-4c2c-bfcd-d334a637fe43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d7be0-48') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.objects.instance [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lazy-loading 'pci_devices' on Instance uuid e1bef3aa-b56f-47e3-8ab2-cf7736787326 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:07:08 user nova-compute[75305]:   <uuid>e1bef3aa-b56f-47e3-8ab2-cf7736787326</uuid>
Nov 14 08:07:08 user nova-compute[75305]:   <name>instance-00000013</name>
Nov 14 08:07:08 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:07:08 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:07:08 user nova-compute[75305]:   <metadata>
Nov 14 08:07:08 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:07:08 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:07:08 user nova-compute[75305]:       <nova:name>tempest-DeleteServersTestJSON-server-1078531263</nova:name>
Nov 14 08:07:08 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:07:08</nova:creationTime>
Nov 14 08:07:08 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:07:08 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:07:08 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:07:08 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:07:08 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:07:08 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:07:08 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:07:08 user nova-compute[75305]:       <nova:owner>
Nov 14 08:07:08 user nova-compute[75305]:         <nova:user uuid="16838539a9744332abe3e3e99c19e9fb">tempest-DeleteServersTestJSON-229895742-project-member</nova:user>
Nov 14 08:07:08 user nova-compute[75305]:         <nova:project uuid="2487b11b988248af93e1d2d2b7c450bb">tempest-DeleteServersTestJSON-229895742</nova:project>
Nov 14 08:07:08 user nova-compute[75305]:       </nova:owner>
Nov 14 08:07:08 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:07:08 user nova-compute[75305]:       <nova:ports>
Nov 14 08:07:08 user nova-compute[75305]:         <nova:port uuid="1f5d7be0-4876-4391-9e2a-33b7a653b49b">
Nov 14 08:07:08 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 08:07:08 user nova-compute[75305]:         </nova:port>
Nov 14 08:07:08 user nova-compute[75305]:       </nova:ports>
Nov 14 08:07:08 user nova-compute[75305]:     </nova:instance>
Nov 14 08:07:08 user nova-compute[75305]:   </metadata>
Nov 14 08:07:08 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:07:08 user nova-compute[75305]:     <system>
Nov 14 08:07:08 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:07:08 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:07:08 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:07:08 user nova-compute[75305]:       <entry name="serial">e1bef3aa-b56f-47e3-8ab2-cf7736787326</entry>
Nov 14 08:07:08 user nova-compute[75305]:       <entry name="uuid">e1bef3aa-b56f-47e3-8ab2-cf7736787326</entry>
Nov 14 08:07:08 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:07:08 user nova-compute[75305]:     </system>
Nov 14 08:07:08 user nova-compute[75305]:   </sysinfo>
Nov 14 08:07:08 user nova-compute[75305]:   <os>
Nov 14 08:07:08 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:07:08 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:07:08 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:07:08 user nova-compute[75305]:   </os>
Nov 14 08:07:08 user nova-compute[75305]:   <features>
Nov 14 08:07:08 user nova-compute[75305]:     <acpi/>
Nov 14 08:07:08 user nova-compute[75305]:     <apic/>
Nov 14 08:07:08 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:07:08 user nova-compute[75305]:   </features>
Nov 14 08:07:08 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:07:08 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:07:08 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:07:08 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:07:08 user nova-compute[75305]:   </clock>
Nov 14 08:07:08 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:07:08 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:07:08 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:07:08 user nova-compute[75305]:   </cpu>
Nov 14 08:07:08 user nova-compute[75305]:   <devices>
Nov 14 08:07:08 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:07:08 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:07:08 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk"/>
Nov 14 08:07:08 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:07:08 user nova-compute[75305]:     </disk>
Nov 14 08:07:08 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:07:08 user nova-compute[75305]:       <mac address="fa:16:3e:1f:69:31"/>
Nov 14 08:07:08 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:07:08 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:07:08 user nova-compute[75305]:       <target dev="tap1f5d7be0-48"/>
Nov 14 08:07:08 user nova-compute[75305]:     </interface>
Nov 14 08:07:08 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:07:08 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/console.log" append="off"/>
Nov 14 08:07:08 user nova-compute[75305]:     </serial>
Nov 14 08:07:08 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:07:08 user nova-compute[75305]:     <video>
Nov 14 08:07:08 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:07:08 user nova-compute[75305]:     </video>
Nov 14 08:07:08 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:07:08 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:07:08 user nova-compute[75305]:     </rng>
Nov 14 08:07:08 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:07:08 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:07:08 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:07:08 user nova-compute[75305]:     </memballoon>
Nov 14 08:07:08 user nova-compute[75305]:   </devices>
Nov 14 08:07:08 user nova-compute[75305]: </domain>
Nov 14 08:07:08 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1078531263',display_name='tempest-DeleteServersTestJSON-server-1078531263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1078531263',id=19,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2487b11b988248af93e1d2d2b7c450bb',ramdisk_id='',reservation_id='r-3zvqvcte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-229895742',owner_user_name='tempest-DeleteServersTestJSON-229895742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:07:05Z,user_data=None,user_id='16838539a9744332abe3e3e99c19e9fb',uuid=e1bef3aa-b56f-47e3-8ab2-cf7736787326,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Converting VIF {"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:69:31,bridge_name='br-int',has_traffic_filtering=True,id=1f5d7be0-4876-4391-9e2a-33b7a653b49b,network=Network(ae5a0424-0ef8-4c2c-bfcd-d334a637fe43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d7be0-48') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG os_vif [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:69:31,bridge_name='br-int',has_traffic_filtering=True,id=1f5d7be0-4876-4391-9e2a-33b7a653b49b,network=Network(ae5a0424-0ef8-4c2c-bfcd-d334a637fe43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d7be0-48') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '16c04eef-b83f-5433-97d1-b482e1be0c0c', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1f5d7be0-48, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1f5d7be0-48, col_values=(('qos', UUID('1f79f03a-176a-46c2-8647-be6a0764ce8c')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1f5d7be0-48, col_values=(('external_ids', {'iface-id': '1f5d7be0-4876-4391-9e2a-33b7a653b49b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:69:31', 'vm-uuid': 'e1bef3aa-b56f-47e3-8ab2-cf7736787326'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:08 user nova-compute[75305]: INFO os_vif [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:69:31,bridge_name='br-int',has_traffic_filtering=True,id=1f5d7be0-4876-4391-9e2a-33b7a653b49b,network=Network(ae5a0424-0ef8-4c2c-bfcd-d334a637fe43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d7be0-48')
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] No VIF found with MAC fa:16:3e:1f:69:31, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.neutron [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Updated VIF entry in instance network info cache for port 1f5d7be0-4876-4391-9e2a-33b7a653b49b. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG nova.network.neutron [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Updating instance_info_cache with network_info: [{"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0146b7ed-1319-48eb-be8d-5f73bf40c921 req-21f59d02-fd4f-4f4a-bc6d-03868183ea8e service nova] Releasing lock "refresh_cache-e1bef3aa-b56f-47e3-8ab2-cf7736787326" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:07:09 user nova-compute[75305]: INFO nova.compute.claims [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Claim successful on node user
Nov 14 08:07:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:07:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.policy [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7906829f99049d2bb0a97c80917cb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b880ff94ef40409fe2b772dee93662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:07:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Creating image(s)
Nov 14 08:07:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "/opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "/opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "/opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "d33d36be252222f277e5d68e7234354a0f550ed5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "d33d36be252222f277e5d68e7234354a0f550ed5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Successfully created port: 9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG nova.virt.images [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] b765263c-c7b9-4d71-ad2e-0a1cab07f385 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.part /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:07:11 user nova-compute[75305]: INFO nova.compute.claims [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Claim successful on node user
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.part /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.converted" returned: 0 in 0.417s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "d33d36be252222f277e5d68e7234354a0f550ed5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.305s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Successfully updated port: 9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing instance network info cache due to event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "d33d36be252222f277e5d68e7234354a0f550ed5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "d33d36be252222f277e5d68e7234354a0f550ed5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:07:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Instance spawned successfully.
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3de80ad7-326d-4385-9b91-510bbb45d477 req-a63d314e-34c8-40e6-8561-256527135b97 service nova] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5,backing_fmt=raw /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:07:12 user nova-compute[75305]: INFO nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5,backing_fmt=raw /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk 1073741824" returned: 0 in 0.070s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "d33d36be252222f277e5d68e7234354a0f550ed5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:07:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.policy [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74b6bdb955524015ad1aec74ee466957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92869b8c2e246ca8f9d361c8ecabac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:07:12 user nova-compute[75305]: INFO nova.compute.manager [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Took 8.17 seconds to build instance.
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json" returned: 0 in 0.202s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-54096266-7b1c-4b93-af52-d4fab81988b0 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.312s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:07:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Creating image(s)
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "/opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Cannot resize image /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Ensure instance console log exists: /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance network_info: |[{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Start _get_guest_xml network_info=[{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T08:07:07Z,direct_url=<?>,disk_format='qcow2',id=b765263c-c7b9-4d71-ad2e-0a1cab07f385,min_disk=0,min_ram=0,name='tempest-scenario-img--108474491',owner='21b880ff94ef40409fe2b772dee93662',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T08:07:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'b765263c-c7b9-4d71-ad2e-0a1cab07f385'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:07:12 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:12 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T08:07:07Z,direct_url=<?>,disk_format='qcow2',id=b765263c-c7b9-4d71-ad2e-0a1cab07f385,min_disk=0,min_ram=0,name='tempest-scenario-img--108474491',owner='21b880ff94ef40409fe2b772dee93662',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T08:07:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1030370936',display_name='tempest-TestMinimumBasicScenario-server-1030370936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1030370936',id=20,image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2RLG9owF1Nc7k0X8tP8zsStohtcewc48Y+CrHnjSnuOkdnHc1S2LIwE7uLd+b7l9fC53B0GI/xmUskFmZD845kIKEB4cJ2YaftNCILebKGzEjZ0424jmXX8dzmF2pI7g==',key_name='tempest-TestMinimumBasicScenario-484244990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-oj8ex2zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:07:11Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=10780135-d628-4567-9825-91df6d78dd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'pci_devices' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:07:13 user nova-compute[75305]:   <uuid>10780135-d628-4567-9825-91df6d78dd22</uuid>
Nov 14 08:07:13 user nova-compute[75305]:   <name>instance-00000014</name>
Nov 14 08:07:13 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:07:13 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:07:13 user nova-compute[75305]:   <metadata>
Nov 14 08:07:13 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:07:13 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:07:13 user nova-compute[75305]:       <nova:name>tempest-TestMinimumBasicScenario-server-1030370936</nova:name>
Nov 14 08:07:13 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:07:12</nova:creationTime>
Nov 14 08:07:13 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:07:13 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:07:13 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:07:13 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:07:13 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:07:13 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:07:13 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:07:13 user nova-compute[75305]:       <nova:owner>
Nov 14 08:07:13 user nova-compute[75305]:         <nova:user uuid="f7906829f99049d2bb0a97c80917cb3a">tempest-TestMinimumBasicScenario-1127831644-project-member</nova:user>
Nov 14 08:07:13 user nova-compute[75305]:         <nova:project uuid="21b880ff94ef40409fe2b772dee93662">tempest-TestMinimumBasicScenario-1127831644</nova:project>
Nov 14 08:07:13 user nova-compute[75305]:       </nova:owner>
Nov 14 08:07:13 user nova-compute[75305]:       <nova:root type="image" uuid="b765263c-c7b9-4d71-ad2e-0a1cab07f385"/>
Nov 14 08:07:13 user nova-compute[75305]:       <nova:ports>
Nov 14 08:07:13 user nova-compute[75305]:         <nova:port uuid="9275f27d-45d9-4ee4-8756-8f0685060d91">
Nov 14 08:07:13 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:07:13 user nova-compute[75305]:         </nova:port>
Nov 14 08:07:13 user nova-compute[75305]:       </nova:ports>
Nov 14 08:07:13 user nova-compute[75305]:     </nova:instance>
Nov 14 08:07:13 user nova-compute[75305]:   </metadata>
Nov 14 08:07:13 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:07:13 user nova-compute[75305]:     <system>
Nov 14 08:07:13 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:07:13 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:07:13 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:07:13 user nova-compute[75305]:       <entry name="serial">10780135-d628-4567-9825-91df6d78dd22</entry>
Nov 14 08:07:13 user nova-compute[75305]:       <entry name="uuid">10780135-d628-4567-9825-91df6d78dd22</entry>
Nov 14 08:07:13 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:07:13 user nova-compute[75305]:     </system>
Nov 14 08:07:13 user nova-compute[75305]:   </sysinfo>
Nov 14 08:07:13 user nova-compute[75305]:   <os>
Nov 14 08:07:13 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:07:13 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:07:13 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:07:13 user nova-compute[75305]:   </os>
Nov 14 08:07:13 user nova-compute[75305]:   <features>
Nov 14 08:07:13 user nova-compute[75305]:     <acpi/>
Nov 14 08:07:13 user nova-compute[75305]:     <apic/>
Nov 14 08:07:13 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:07:13 user nova-compute[75305]:   </features>
Nov 14 08:07:13 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:07:13 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:07:13 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:07:13 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:07:13 user nova-compute[75305]:   </clock>
Nov 14 08:07:13 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:07:13 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:07:13 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:07:13 user nova-compute[75305]:   </cpu>
Nov 14 08:07:13 user nova-compute[75305]:   <devices>
Nov 14 08:07:13 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:07:13 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:07:13 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk"/>
Nov 14 08:07:13 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:07:13 user nova-compute[75305]:     </disk>
Nov 14 08:07:13 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:07:13 user nova-compute[75305]:       <mac address="fa:16:3e:8f:2f:04"/>
Nov 14 08:07:13 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:07:13 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:07:13 user nova-compute[75305]:       <target dev="tap9275f27d-45"/>
Nov 14 08:07:13 user nova-compute[75305]:     </interface>
Nov 14 08:07:13 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:07:13 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/console.log" append="off"/>
Nov 14 08:07:13 user nova-compute[75305]:     </serial>
Nov 14 08:07:13 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:07:13 user nova-compute[75305]:     <video>
Nov 14 08:07:13 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:07:13 user nova-compute[75305]:     </video>
Nov 14 08:07:13 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:07:13 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:07:13 user nova-compute[75305]:     </rng>
Nov 14 08:07:13 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:07:13 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:07:13 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:07:13 user nova-compute[75305]:     </memballoon>
Nov 14 08:07:13 user nova-compute[75305]:   </devices>
Nov 14 08:07:13 user nova-compute[75305]: </domain>
Nov 14 08:07:13 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1030370936',display_name='tempest-TestMinimumBasicScenario-server-1030370936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1030370936',id=20,image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2RLG9owF1Nc7k0X8tP8zsStohtcewc48Y+CrHnjSnuOkdnHc1S2LIwE7uLd+b7l9fC53B0GI/xmUskFmZD845kIKEB4cJ2YaftNCILebKGzEjZ0424jmXX8dzmF2pI7g==',key_name='tempest-TestMinimumBasicScenario-484244990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-oj8ex2zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:07:11Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=10780135-d628-4567-9825-91df6d78dd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG os_vif [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bb23ebb-657a-5385-9b03-5215aed8baa7', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9275f27d-45, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9275f27d-45, col_values=(('qos', UUID('2fe59236-1655-4a2b-b740-e952d0b0c078')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9275f27d-45, col_values=(('external_ids', {'iface-id': '9275f27d-45d9-4ee4-8756-8f0685060d91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:2f:04', 'vm-uuid': '10780135-d628-4567-9825-91df6d78dd22'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:13 user nova-compute[75305]: INFO os_vif [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45')
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.193s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Successfully created port: 8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk 1073741824" returned: 0 in 0.066s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No VIF found with MAC fa:16:3e:8f:2f:04, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Cannot resize image /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Ensure instance console log exists: /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received event network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] No waiting events found dispatching network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:07:14 user nova-compute[75305]: WARNING nova.compute.manager [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received unexpected event network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b for instance with vm_state active and task_state None.
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received event network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] No waiting events found dispatching network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:07:14 user nova-compute[75305]: WARNING nova.compute.manager [req-9672e241-a01a-4770-8304-f58dd8364f23 req-a2d3eaab-b0f9-42b2-b9e0-7bed195e6db5 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received unexpected event network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b for instance with vm_state active and task_state None.
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Successfully updated port: 8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received event network-changed-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Refreshing instance network info cache due to event network-changed-8e036b50-5d50-45a4-a21f-205fb17beb6f. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] Acquiring lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updating instance_info_cache with network_info: [{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Instance network_info: |[{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] Acquired lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Refreshing network info cache for port 8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Start _get_guest_xml network_info=[{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-572658733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-572658733',id=21,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-ork7weqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:07:13Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=d16d469c-6caf-4ba0-869e-2eb0c4908d24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7e:5b,bridge_name='br-int',has_traffic_filtering=True,id=8e036b50-5d50-45a4-a21f-205fb17beb6f,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e036b50-5d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'pci_devices' on Instance uuid d16d469c-6caf-4ba0-869e-2eb0c4908d24 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:07:14 user nova-compute[75305]:   <uuid>d16d469c-6caf-4ba0-869e-2eb0c4908d24</uuid>
Nov 14 08:07:14 user nova-compute[75305]:   <name>instance-00000015</name>
Nov 14 08:07:14 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:07:14 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:07:14 user nova-compute[75305]:   <metadata>
Nov 14 08:07:14 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:07:14 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:07:14 user nova-compute[75305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-572658733</nova:name>
Nov 14 08:07:14 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:07:14</nova:creationTime>
Nov 14 08:07:14 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:07:14 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:07:14 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:07:14 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:07:14 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:07:14 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:07:14 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:07:14 user nova-compute[75305]:       <nova:owner>
Nov 14 08:07:14 user nova-compute[75305]:         <nova:user uuid="74b6bdb955524015ad1aec74ee466957">tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member</nova:user>
Nov 14 08:07:14 user nova-compute[75305]:         <nova:project uuid="f92869b8c2e246ca8f9d361c8ecabac0">tempest-ServerBootFromVolumeStableRescueTest-983718269</nova:project>
Nov 14 08:07:14 user nova-compute[75305]:       </nova:owner>
Nov 14 08:07:14 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:07:14 user nova-compute[75305]:       <nova:ports>
Nov 14 08:07:14 user nova-compute[75305]:         <nova:port uuid="8e036b50-5d50-45a4-a21f-205fb17beb6f">
Nov 14 08:07:14 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 08:07:14 user nova-compute[75305]:         </nova:port>
Nov 14 08:07:14 user nova-compute[75305]:       </nova:ports>
Nov 14 08:07:14 user nova-compute[75305]:     </nova:instance>
Nov 14 08:07:14 user nova-compute[75305]:   </metadata>
Nov 14 08:07:14 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:07:14 user nova-compute[75305]:     <system>
Nov 14 08:07:14 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:07:14 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:07:14 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:07:14 user nova-compute[75305]:       <entry name="serial">d16d469c-6caf-4ba0-869e-2eb0c4908d24</entry>
Nov 14 08:07:14 user nova-compute[75305]:       <entry name="uuid">d16d469c-6caf-4ba0-869e-2eb0c4908d24</entry>
Nov 14 08:07:14 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:07:14 user nova-compute[75305]:     </system>
Nov 14 08:07:14 user nova-compute[75305]:   </sysinfo>
Nov 14 08:07:14 user nova-compute[75305]:   <os>
Nov 14 08:07:14 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:07:14 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:07:14 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:07:14 user nova-compute[75305]:   </os>
Nov 14 08:07:14 user nova-compute[75305]:   <features>
Nov 14 08:07:14 user nova-compute[75305]:     <acpi/>
Nov 14 08:07:14 user nova-compute[75305]:     <apic/>
Nov 14 08:07:14 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:07:14 user nova-compute[75305]:   </features>
Nov 14 08:07:14 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:07:14 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:07:14 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:07:14 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:07:14 user nova-compute[75305]:   </clock>
Nov 14 08:07:14 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:07:14 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:07:14 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:07:14 user nova-compute[75305]:   </cpu>
Nov 14 08:07:14 user nova-compute[75305]:   <devices>
Nov 14 08:07:14 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:07:14 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:07:14 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk"/>
Nov 14 08:07:14 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:07:14 user nova-compute[75305]:     </disk>
Nov 14 08:07:14 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:07:14 user nova-compute[75305]:       <mac address="fa:16:3e:7e:7e:5b"/>
Nov 14 08:07:14 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:07:14 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:07:14 user nova-compute[75305]:       <target dev="tap8e036b50-5d"/>
Nov 14 08:07:14 user nova-compute[75305]:     </interface>
Nov 14 08:07:14 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:07:14 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/console.log" append="off"/>
Nov 14 08:07:14 user nova-compute[75305]:     </serial>
Nov 14 08:07:14 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:07:14 user nova-compute[75305]:     <video>
Nov 14 08:07:14 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:07:14 user nova-compute[75305]:     </video>
Nov 14 08:07:14 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:07:14 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:07:14 user nova-compute[75305]:     </rng>
Nov 14 08:07:14 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:07:14 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:07:14 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:07:14 user nova-compute[75305]:     </memballoon>
Nov 14 08:07:14 user nova-compute[75305]:   </devices>
Nov 14 08:07:14 user nova-compute[75305]: </domain>
Nov 14 08:07:14 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-572658733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-572658733',id=21,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-ork7weqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:07:13Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=d16d469c-6caf-4ba0-869e-2eb0c4908d24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7e:5b,bridge_name='br-int',has_traffic_filtering=True,id=8e036b50-5d50-45a4-a21f-205fb17beb6f,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e036b50-5d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG os_vif [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7e:5b,bridge_name='br-int',has_traffic_filtering=True,id=8e036b50-5d50-45a4-a21f-205fb17beb6f,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e036b50-5d') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '115e5134-a120-54ac-b402-febfa7415c59', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e036b50-5d, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e036b50-5d, col_values=(('qos', UUID('f9937718-333f-4b8a-b506-5677fbcd0276')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e036b50-5d, col_values=(('external_ids', {'iface-id': '8e036b50-5d50-45a4-a21f-205fb17beb6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:7e:5b', 'vm-uuid': 'd16d469c-6caf-4ba0-869e-2eb0c4908d24'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:14 user nova-compute[75305]: INFO os_vif [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:7e:5b,bridge_name='br-int',has_traffic_filtering=True,id=8e036b50-5d50-45a4-a21f-205fb17beb6f,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e036b50-5d')
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:07:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No VIF found with MAC fa:16:3e:7e:7e:5b, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:07:15 user nova-compute[75305]: DEBUG nova.network.neutron [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updated VIF entry in instance network info cache for port 8e036b50-5d50-45a4-a21f-205fb17beb6f. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:07:15 user nova-compute[75305]: DEBUG nova.network.neutron [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updating instance_info_cache with network_info: [{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-304bbc60-769f-42d9-adc8-16a6c85921aa req-6009c1a4-488c-4de9-aa46-818498f8b14f service nova] Releasing lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-d0980a86-e51c-4c07-874c-45113d80a958 req-d6f8013a-51cf-4709-844e-fa0cf730c5da service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d0980a86-e51c-4c07-874c-45113d80a958 req-d6f8013a-51cf-4709-844e-fa0cf730c5da service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d0980a86-e51c-4c07-874c-45113d80a958 req-d6f8013a-51cf-4709-844e-fa0cf730c5da service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d0980a86-e51c-4c07-874c-45113d80a958 req-d6f8013a-51cf-4709-844e-fa0cf730c5da service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-d0980a86-e51c-4c07-874c-45113d80a958 req-d6f8013a-51cf-4709-844e-fa0cf730c5da service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:07:16 user nova-compute[75305]: WARNING nova.compute.manager [req-d0980a86-e51c-4c07-874c-45113d80a958 req-d6f8013a-51cf-4709-844e-fa0cf730c5da service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state building and task_state spawning.
Nov 14 08:07:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-316c993d-cb34-4127-9627-cf63da1ff523 req-a1ddbea6-818e-4ce3-8f44-9de2e878f68f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received event network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-316c993d-cb34-4127-9627-cf63da1ff523 req-a1ddbea6-818e-4ce3-8f44-9de2e878f68f service nova] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-316c993d-cb34-4127-9627-cf63da1ff523 req-a1ddbea6-818e-4ce3-8f44-9de2e878f68f service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-316c993d-cb34-4127-9627-cf63da1ff523 req-a1ddbea6-818e-4ce3-8f44-9de2e878f68f service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-316c993d-cb34-4127-9627-cf63da1ff523 req-a1ddbea6-818e-4ce3-8f44-9de2e878f68f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] No waiting events found dispatching network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:07:16 user nova-compute[75305]: WARNING nova.compute.manager [req-316c993d-cb34-4127-9627-cf63da1ff523 req-a1ddbea6-818e-4ce3-8f44-9de2e878f68f service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received unexpected event network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f for instance with vm_state building and task_state spawning.
Nov 14 08:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-779ac1cb-e270-4958-87fd-6a82dce70a43 req-1eaaff50-d815-475d-8e3f-82f3732a0b84 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-779ac1cb-e270-4958-87fd-6a82dce70a43 req-1eaaff50-d815-475d-8e3f-82f3732a0b84 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-779ac1cb-e270-4958-87fd-6a82dce70a43 req-1eaaff50-d815-475d-8e3f-82f3732a0b84 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-779ac1cb-e270-4958-87fd-6a82dce70a43 req-1eaaff50-d815-475d-8e3f-82f3732a0b84 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-779ac1cb-e270-4958-87fd-6a82dce70a43 req-1eaaff50-d815-475d-8e3f-82f3732a0b84 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:07:18 user nova-compute[75305]: WARNING nova.compute.manager [req-779ac1cb-e270-4958-87fd-6a82dce70a43 req-1eaaff50-d815-475d-8e3f-82f3732a0b84 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state building and task_state spawning.
Nov 14 08:07:18 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance spawned successfully.
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: INFO nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Took 7.49 seconds to spawn the instance on the hypervisor.
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-dcc8a781-3403-4eca-8411-a3f40f08803c req-1c00fbd4-8e71-4bf0-8965-c4cad7562147 service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received event network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dcc8a781-3403-4eca-8411-a3f40f08803c req-1c00fbd4-8e71-4bf0-8965-c4cad7562147 service nova] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dcc8a781-3403-4eca-8411-a3f40f08803c req-1c00fbd4-8e71-4bf0-8965-c4cad7562147 service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dcc8a781-3403-4eca-8411-a3f40f08803c req-1c00fbd4-8e71-4bf0-8965-c4cad7562147 service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-dcc8a781-3403-4eca-8411-a3f40f08803c req-1c00fbd4-8e71-4bf0-8965-c4cad7562147 service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] No waiting events found dispatching network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:07:18 user nova-compute[75305]: WARNING nova.compute.manager [req-dcc8a781-3403-4eca-8411-a3f40f08803c req-1c00fbd4-8e71-4bf0-8965-c4cad7562147 service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received unexpected event network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f for instance with vm_state building and task_state spawning.
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.378s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:07:18 user nova-compute[75305]: INFO nova.compute.manager [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Took 8.77 seconds to build instance.
Nov 14 08:07:18 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Instance spawned successfully.
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7e5956c-3ae5-4df9-9dfa-866854fcee05 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.871s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:18 user nova-compute[75305]: INFO nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 14 08:07:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:07:18 user nova-compute[75305]: INFO nova.compute.manager [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Took 7.29 seconds to build instance.
Nov 14 08:07:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4efd794a-290b-49f0-a1e6-0b4133aa651a tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.501s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:07:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7246MB free_disk=25.171783447265625GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:07:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Applying migration context for instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace as it has an incoming, in-progress migration 01ed8c82-3f87-450b-93ba-f2be8e98d473. Migration status is finished {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 08:07:23 user nova-compute[75305]: INFO nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating resource usage from migration 01ed8c82-3f87-450b-93ba-f2be8e98d473
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6dd11b5a-6147-4cd1-965a-19f75a091198 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5959dc8-a417-4528-9f03-3951186c2315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Migration 01ed8c82-3f87-450b-93ba-f2be8e98d473 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance c837ffe0-c080-444e-a327-a7781f6d49bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance e1bef3aa-b56f-47e3-8ab2-cf7736787326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 10780135-d628-4567-9825-91df6d78dd22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:07:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.757s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:07:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:07:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:07:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:28 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6dd11b5a-6147-4cd1-965a-19f75a091198 is timed out.
Nov 14 08:07:28 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully detached device vdb from instance 6dd11b5a-6147-4cd1-965a-19f75a091198 from the live domain config.
Nov 14 08:07:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cnfrwSPv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:07:28 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12be01aa-8f5d-45f2-8792-a94eedfa2194]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:07:28 user nova-compute[75305]: No targets found.
Nov 14 08:07:28 user nova-compute[75305]: iSNS:
Nov 14 08:07:28 user nova-compute[75305]: No targets found.
Nov 14 08:07:28 user nova-compute[75305]: STATIC:
Nov 14 08:07:28 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b
Nov 14 08:07:28 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:07:28 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:07:28 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:07:28 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:07:28 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:07:28 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:07:28 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:07:28 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:07:28 user nova-compute[75305]: FIRMWARE:
Nov 14 08:07:28 user nova-compute[75305]: No targets found.
Nov 14 08:07:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:07:28 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:07:28 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0978d6d-f70c-47e7-bd5f-9933ed67ac18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[544e8eb9-f56e-4a4c-b7a1-22d676dafe0c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:07:28 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:07:28 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:07:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:07:28 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:07:28 user nova-compute[75305]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b (non-flash)
Nov 14 08:07:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4410dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b'): ({'sdh'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Removing single pathed devices sdh {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fa7949-3a1f-4d99-a71e-2601874beb46]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[684852d4-b41e-413a-a1e8-3f4cd1a4a332]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flushing IO for device /dev/sdh {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[764f7a36-f143-4509-9b51-2ce0cf8c67bf]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.063s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e36d28-6b02-46ef-a175-4fc18913ef5a]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] SCSI volumes sdh have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[258fca54-fa6f-48f1-a1fc-7740a2c1eade]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe1273c-fc3c-491b-ab72-83542ea5a007]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260]
Nov 14 08:07:28 user nova-compute[75305]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b, portal: 172.16.0.220,3260] successful.
Nov 14 08:07:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78216012-bbe0-49ba-942f-885dd281d83b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7040d52b-38d8-44fb-a922-01d251931fef]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== disconnect_volume: return (319ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:07:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:07:29 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid 6dd11b5a-6147-4cd1-965a-19f75a091198 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:07:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a6076d3-1218-4a24-b751-96dc988781bc tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.795s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-changed-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Refreshing instance network info cache due to event network-changed-2cca97fb-fc47-47b5-a480-2082f53a52db. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] Acquiring lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] Acquired lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG nova.network.neutron [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Refreshing network info cache for port 2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG nova.network.neutron [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updated VIF entry in instance network info cache for port 2cca97fb-fc47-47b5-a480-2082f53a52db. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG nova.network.neutron [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updating instance_info_cache with network_info: [{"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-72dbf4f7-e564-42ad-8981-2fa460b13e68 req-4dfbd9ff-3c24-4a08-a764-bf04e739f6e2 service nova] Releasing lock "refresh_cache-1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:55 user nova-compute[75305]: INFO nova.compute.manager [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Attaching volume c6570597-882f-4c7c-8d5d-b12f8552ad16 to /dev/vdb
Nov 14 08:07:55 user nova-compute[75305]: DEBUG os_brick.utils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e493bf2a-75e7-46b2-afc4-6833c0ba5641]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb62e2e-41a5-45e6-908b-48e5e21ed4d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e55121-bedc-4565-8332-eb487ca38164]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2f59d3-413e-4b5e-a2df-2d854d1d65a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:07:56 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:07:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85a0520-270d-4b47-9d02-b0bd4ef159e1]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG os_brick.utils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:07:56 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updating existing volume attachment record: 58f03858-3ce7-4a8a-8e2f-fa67f302ffc0 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:57 user nova-compute[75305]: INFO nova.compute.manager [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Terminating instance
Nov 14 08:07:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-d8e94287-530c-47cb-aede-c60540d206a8 req-966d37f9-2e30-4b0e-84a6-3cec5fe702e5 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-vif-unplugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8e94287-530c-47cb-aede-c60540d206a8 req-966d37f9-2e30-4b0e-84a6-3cec5fe702e5 service nova] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8e94287-530c-47cb-aede-c60540d206a8 req-966d37f9-2e30-4b0e-84a6-3cec5fe702e5 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8e94287-530c-47cb-aede-c60540d206a8 req-966d37f9-2e30-4b0e-84a6-3cec5fe702e5 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-d8e94287-530c-47cb-aede-c60540d206a8 req-966d37f9-2e30-4b0e-84a6-3cec5fe702e5 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] No waiting events found dispatching network-vif-unplugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-d8e94287-530c-47cb-aede-c60540d206a8 req-966d37f9-2e30-4b0e-84a6-3cec5fe702e5 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-vif-unplugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:07:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Instance destroyed successfully.
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'resources' on Instance uuid 6dd11b5a-6147-4cd1-965a-19f75a091198 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-89483256',display_name='tempest-AttachVolumeNegativeTest-server-89483256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-89483256',id=4,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCySHxoMFLrXs08uhdcGYy02FJJfNatLmr/7HW18vIP10bYQ5HjK4yTPrw9f/QBmtcMyIfFc3hk75XXBd/AOBEq3jvevcV7zcnnGjweI6bUsFRjsdndjGgVnUhWkDb3H+w==',key_name='tempest-keypair-1025161906',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-khbh2iv0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=6dd11b5a-6147-4cd1-965a-19f75a091198,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "address": "fa:16:3e:86:a0:f3", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap488cb4fa-c0", "ovs_interfaceid": "488cb4fa-c020-4834-a6e0-62c7f76dd23d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=488cb4fa-c020-4834-a6e0-62c7f76dd23d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488cb4fa-c0') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG os_vif [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=488cb4fa-c020-4834-a6e0-62c7f76dd23d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488cb4fa-c0') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap488cb4fa-c0, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72c01b72-fc68-4149-a5bd-d3429f057585) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:07:58 user nova-compute[75305]: INFO os_vif [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:a0:f3,bridge_name='br-int',has_traffic_filtering=True,id=488cb4fa-c020-4834-a6e0-62c7f76dd23d,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap488cb4fa-c0')
Nov 14 08:07:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Deleting instance files /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198_del
Nov 14 08:07:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Deletion of /opt/stack/data/nova/instances/6dd11b5a-6147-4cd1-965a-19f75a091198_del complete
Nov 14 08:07:58 user nova-compute[75305]: INFO nova.compute.manager [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 08:07:58 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:07:58 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:07:59 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:07:59 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Took 0.91 seconds to deallocate network for instance.
Nov 14 08:07:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:07:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:07:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-225a4103-1ed3-42e9-8306-dfae2f39a59b req-a973ece4-2d2a-4ccd-a727-9ef96565d6a6 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-vif-deleted-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:00 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Deleted allocations for instance 6dd11b5a-6147-4cd1-965a-19f75a091198
Nov 14 08:08:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:00 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:00 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:00 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086c8d2-9b4f-4a17-b0de-25583f216d40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:08:00 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c660c55-0d5f-4bad-aacf-7ef863d0e850 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa404b4f-9a22-4c88-bf88-f4e351701b54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16] added
Nov 14 08:08:00 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ff169-48fb-4e74-afca-57ed0146dcdc]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b797526-62de-4d91-8ef8-1a6cf32d0dee]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-8942f534-a472-4b27-9e81-660d2b6df516 req-297f98e8-5205-4a43-a10b-972e5eed6bd1 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received event network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8942f534-a472-4b27-9e81-660d2b6df516 req-297f98e8-5205-4a43-a10b-972e5eed6bd1 service nova] Acquiring lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8942f534-a472-4b27-9e81-660d2b6df516 req-297f98e8-5205-4a43-a10b-972e5eed6bd1 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8942f534-a472-4b27-9e81-660d2b6df516 req-297f98e8-5205-4a43-a10b-972e5eed6bd1 service nova] Lock "6dd11b5a-6147-4cd1-965a-19f75a091198-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-8942f534-a472-4b27-9e81-660d2b6df516 req-297f98e8-5205-4a43-a10b-972e5eed6bd1 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] No waiting events found dispatching network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:00 user nova-compute[75305]: WARNING nova.compute.manager [req-8942f534-a472-4b27-9e81-660d2b6df516 req-297f98e8-5205-4a43-a10b-972e5eed6bd1 service nova] [instance: 6dd11b5a-6147-4cd1-965a-19f75a091198] Received unexpected event network-vif-plugged-488cb4fa-c020-4834-a6e0-62c7f76dd23d for instance with vm_state deleted and task_state None.
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJqNFgwG {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJqNFgwG" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb4126b-da54-4727-8804-270c949bf991]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJqNFgwG'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[982acb83-71a9-426d-936e-8528d52a74cf]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e670cd0d-bf75-4f43-bf61-916838515aa2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f808351a-f5e7-4b83-8533-de3533efc90a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]
Nov 14 08:08:00 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:00 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaf0d63-a592-4f13-9946-fdfde047749f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6584c8a-e56b-4a88-a34b-6226d6e8fd65]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:00 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1982a9b-3c7d-4822-ac3e-bd8e2b01451d]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:00 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:01 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:08:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26333343230663934', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333343230663934', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:08:01 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:08:01 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:01 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:08:01 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:01 user nova-compute[75305]:   <serial>c6570597-882f-4c7c-8d5d-b12f8552ad16</serial>
Nov 14 08:08:01 user nova-compute[75305]: </disk>
Nov 14 08:08:01 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:08:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No VIF found with MAC fa:16:3e:b4:e9:01, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:08:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a025d246-3fd1-4711-a342-932ec61d30fc tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.298s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:03 user nova-compute[75305]: INFO nova.compute.manager [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Unrescuing
Nov 14 08:08:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: INFO nova.compute.manager [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Rebuilding instance
Nov 14 08:08:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'flavor' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-62c5e3af-82ee-41ab-84df-2272356d1b62 req-b90da474-7c45-4a23-95c8-ab4bead26e63 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-unplugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-62c5e3af-82ee-41ab-84df-2272356d1b62 req-b90da474-7c45-4a23-95c8-ab4bead26e63 service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-62c5e3af-82ee-41ab-84df-2272356d1b62 req-b90da474-7c45-4a23-95c8-ab4bead26e63 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-62c5e3af-82ee-41ab-84df-2272356d1b62 req-b90da474-7c45-4a23-95c8-ab4bead26e63 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-62c5e3af-82ee-41ab-84df-2272356d1b62 req-b90da474-7c45-4a23-95c8-ab4bead26e63 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-unplugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:03 user nova-compute[75305]: WARNING nova.compute.manager [req-62c5e3af-82ee-41ab-84df-2272356d1b62 req-b90da474-7c45-4a23-95c8-ab4bead26e63 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received unexpected event network-vif-unplugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with vm_state active and task_state rebuilding.
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-changed-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing instance network info cache due to event network-changed-11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance destroyed successfully.
Nov 14 08:08:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance destroyed successfully.
Nov 14 08:08:04 user nova-compute[75305]: INFO nova.compute.manager [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Detaching volume c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:04 user nova-compute[75305]: INFO nova.virt.block_device [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Attempting to driver detach volume c6570597-882f-4c7c-8d5d-b12f8552ad16 from mountpoint /dev/vdb
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Attempting to detach device vdb from instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:08:04 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:04 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:08:04 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:04 user nova-compute[75305]:   <serial>c6570597-882f-4c7c-8d5d-b12f8552ad16</serial>
Nov 14 08:08:04 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:08:04 user nova-compute[75305]: </disk>
Nov 14 08:08:04 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:08:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully detached device vdb from instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e from the persistent domain config.
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:04 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dffbf3-14a4-4257-b8b2-fdee958d2758]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:04 user nova-compute[75305]: No targets found.
Nov 14 08:08:04 user nova-compute[75305]: iSNS:
Nov 14 08:08:04 user nova-compute[75305]: No targets found.
Nov 14 08:08:04 user nova-compute[75305]: STATIC:
Nov 14 08:08:04 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:04 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:04 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:04 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:04 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:04 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:04 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:08:04 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:04 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:04 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:04 user nova-compute[75305]: No targets found.
Nov 14 08:08:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:04 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:04 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4fc32d-3a56-4599-832d-632cde2a7b2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updated VIF entry in instance network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf484d3-cd97-4340-9fe7-5e5f16494fa6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:04 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:04 user nova-compute[75305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:04 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:04 user nova-compute[75305]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442a9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-96781f43-f1bb-479d-af39-c9380c43d7a3 req-5eb82df5-d59b-4869-8e20-2e3e1226211b service nova] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebcb302-4b58-4f1c-96b5-6c2d55efcbae]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1afe41a-b364-4236-b815-c5e4c32de655]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e488d-2097-42ff-819b-f11397d80932]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b727a2ef-b6f0-4f63-9644-a7c0fb06981e]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fea81e-6198-4a67-9575-afa80b9a87d0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdbaa9a-c9cc-4ca3-b2ed-f2059ecd6c37]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]
Nov 14 08:08:05 user nova-compute[75305]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83063873-4ff5-4400-9432-0ea40ca663ae]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== disconnect_volume: return (316ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Port 9f99886b-aaf5-4e84-a5d2-2e74015f4386 binding to destination host user is already ACTIVE {{(pid=75305) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Creating tmpfile /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/tmprf_ih3xx to verify with other compute node that the instance is on the same shared storage. {{(pid=75305) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:05 user nova-compute[75305]: WARNING nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received unexpected event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with vm_state active and task_state rebuilding.
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:05 user nova-compute[75305]: WARNING nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:05 user nova-compute[75305]: WARNING nova.compute.manager [req-90128b6c-f307-457f-84cb-14898bb4d7a6 req-e8a7beff-a2b0-43fe-a29e-f8fefc435ee3 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance destroyed successfully.
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-282595868',display_name='tempest-ServerActionsTestOtherA-server-102191055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-282595868',id=15,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATQaebgY6FVuDzfByi4n+NZkAFhSWDDR3cOgUOfYqPhuzhPRZQAh2rqky1pom02R6jbd5n7JWx9caNElsIemhUwnvUJsbZN0JtdgFrUe+kcbMjv4SOyBmEz18HgXewRhg==',key_name='tempest-keypair-1756979960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-jrdab4sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=1a8e1fa0-e30d-4940-b08d-15cfe8b1737e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_vif [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cca97fb-fc, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5eff7ec-de55-4e7b-b229-c0b855a8e602) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-6b9969f4-bd4f-4f93-8307-3a0c2ea56ecc req-94ebba87-6f77-4707-a1a9-22905e27e63d service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6b9969f4-bd4f-4f93-8307-3a0c2ea56ecc req-94ebba87-6f77-4707-a1a9-22905e27e63d service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6b9969f4-bd4f-4f93-8307-3a0c2ea56ecc req-94ebba87-6f77-4707-a1a9-22905e27e63d service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6b9969f4-bd4f-4f93-8307-3a0c2ea56ecc req-94ebba87-6f77-4707-a1a9-22905e27e63d service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-6b9969f4-bd4f-4f93-8307-3a0c2ea56ecc req-94ebba87-6f77-4707-a1a9-22905e27e63d service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:05 user nova-compute[75305]: WARNING nova.compute.manager [req-6b9969f4-bd4f-4f93-8307-3a0c2ea56ecc req-94ebba87-6f77-4707-a1a9-22905e27e63d service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state resized and task_state resize_reverting.
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:05 user nova-compute[75305]: INFO os_vif [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc')
Nov 14 08:08:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:05 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[241910cb-3df2-461c-803c-fe49efbc171f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:05 user nova-compute[75305]: No targets found.
Nov 14 08:08:05 user nova-compute[75305]: iSNS:
Nov 14 08:08:05 user nova-compute[75305]: No targets found.
Nov 14 08:08:05 user nova-compute[75305]: STATIC:
Nov 14 08:08:05 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:05 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:05 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:05 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:05 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:05 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:05 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:05 user nova-compute[75305]: No targets found.
Nov 14 08:08:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:05 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:05 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f417202-9399-42b9-9749-8f82128ac73e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6b84cf-fbc7-4c34-9d2b-3a08bfe67587]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf20704d30>, {}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Disconnecting from: [] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.078s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== disconnect_volume: return (85ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Deleting instance files /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e_del
Nov 14 08:08:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Deletion of /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e_del complete
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-changed-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing instance network info cache due to event network-changed-11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] Acquiring lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] Acquired lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.network.neutron [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Refreshing network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:08:06 user nova-compute[75305]: INFO nova.virt.block_device [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Booting with volume c6570597-882f-4c7c-8d5d-b12f8552ad16 at /dev/vdb
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.utils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8101d662-8dbc-4044-b36f-bf94886a2bf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0319d0a1-2d0f-437c-a98b-cf8c6bc4fa2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c000efc-ba44-4a77-8d1b-3e745f5889eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[969f4a88-9336-418c-8f5e-7ed75f1212ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:06 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c184e7d-92b1-4f9a-b8f2-eda9feeed19e]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.utils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updating existing volume attachment record: f76fd4e1-2f7a-40f6-8cca-f16fa8591a9f {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:08:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance destroyed successfully.
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lazy-loading 'resources' on Instance uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:06:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_vif [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f99886b-aa, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5b7568c-12ae-4265-b405-8c222cab209b) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:06 user nova-compute[75305]: INFO os_vif [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa')
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:06 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb7b5f8-0ae4-46ba-b080-b9f1abe8536e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:06 user nova-compute[75305]: No targets found.
Nov 14 08:08:06 user nova-compute[75305]: iSNS:
Nov 14 08:08:06 user nova-compute[75305]: No targets found.
Nov 14 08:08:06 user nova-compute[75305]: STATIC:
Nov 14 08:08:06 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:06 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:06 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:06 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:06 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:06 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:06 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:06 user nova-compute[75305]: No targets found.
Nov 14 08:08:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:06 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:06 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb992247-0039-4975-a14d-02ee2b289332]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86289627-5eac-4e66-9bd4-99861e1e168a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5e5e3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33'): ({'sde'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Removing single pathed devices sde {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.network.neutron [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updated VIF entry in instance network info cache for port 11d90697-5697-4fd9-8284-99e99196df6e. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG nova.network.neutron [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [{"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e96e6a85-9563-4d9f-835c-740174f27000 req-646cf101-4cbb-43d1-8e3e-26804bce6d2b service nova] Releasing lock "refresh_cache-f5959dc8-a417-4528-9f03-3951186c2315" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ee9e9a-4897-41b3-8204-fab84f800f74]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c9167b-8cf8-44fc-8b7e-eaa7eee554f5]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flushing IO for device /dev/sde {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3189d7b-35b4-47b9-b2f9-a93db4152627]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77d4f19-418a-465f-8313-afb50e7a149d]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f7a951-eacd-4040-85ed-bb9b55f268be]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2a3916-56c4-462d-9e21-d369333da2a2]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]
Nov 14 08:08:07 user nova-compute[75305]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:07 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3abf05-bd3b-415d-8999-daf0a3b3adf7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== disconnect_volume: return (318ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:07 user nova-compute[75305]: WARNING nova.compute.manager [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:07 user nova-compute[75305]: WARNING nova.compute.manager [req-9b666d6b-6a88-48a8-ad42-4ee58c5f147c req-d1de1aec-bebd-451f-817b-6c902b7eea29 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-8923f000-a638-48da-b224-4cdb39e3a6e7 req-ec2d1756-bea9-45c4-99db-8e798c4be305 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8923f000-a638-48da-b224-4cdb39e3a6e7 req-ec2d1756-bea9-45c4-99db-8e798c4be305 service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8923f000-a638-48da-b224-4cdb39e3a6e7 req-ec2d1756-bea9-45c4-99db-8e798c4be305 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8923f000-a638-48da-b224-4cdb39e3a6e7 req-ec2d1756-bea9-45c4-99db-8e798c4be305 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-8923f000-a638-48da-b224-4cdb39e3a6e7 req-ec2d1756-bea9-45c4-99db-8e798c4be305 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:07 user nova-compute[75305]: WARNING nova.compute.manager [req-8923f000-a638-48da-b224-4cdb39e3a6e7 req-ec2d1756-bea9-45c4-99db-8e798c4be305 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state resized and task_state resize_reverting.
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lazy-loading 'migration_context' on Instance uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:07 user nova-compute[75305]: DEBUG nova.objects.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Object Instance<ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace> lazy-loaded attributes: resources,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.478s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3365a2a8-0dc8-407b-8a66-fc6705eb190f tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:08:08 user nova-compute[75305]: INFO nova.compute.manager [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Swapping old allocation on dict_keys(['b140deac-8ace-4c60-902f-ce7a9011677b']) held by migration 01ed8c82-3f87-450b-93ba-f2be8e98d473 for instance
Nov 14 08:08:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Overwriting current allocation {'allocations': {'b140deac-8ace-4c60-902f-ce7a9011677b': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 25}}, 'project_id': 'cd8b5236976e4be48b494cdbc69015b4', 'user_id': '7dda8620115b4ad5a5acc0c811ef44ee', 'consumer_generation': 1} on consumer ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquired lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:08 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Releasing lock "refresh_cache-ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG os_brick.utils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f410c091-93e6-4916-9551-e986aa05af30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c200636-f482-4391-8f87-5d70c15bc11a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[87976f9e-928a-42fa-8004-d3a29601de69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2232b72-1102-4948-a963-ea45b2b8fec6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:09 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:08:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdb73aa-bedc-4008-aeee-ce2b14c1533a]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:08:09 user nova-compute[75305]: DEBUG os_brick.utils [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:08:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Creating image(s)
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk 1073741824" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:08:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Cannot resize image /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Ensure instance console log exists: /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Start _get_guest_xml network_info=[{"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'f76fd4e1-2f7a-40f6-8cca-f16fa8591a9f', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a8e1fa0-e30d-4940-b08d-15cfe8b1737e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6570597-882f-4c7c-8d5d-b12f8552ad16', 'serial': 'c6570597-882f-4c7c-8d5d-b12f8552ad16'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:08:12 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 08:08:12 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:12 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:12 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:12 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0233a778-ac4d-4ac5-8c7a-3e557057b16b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:08:12 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f8d7e6-40cd-43f5-bc43-376e667022d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16] added
Nov 14 08:08:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2260d2-d5be-4ccc-bf48-16ac247e5d36]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c417183-02c1-40bc-94ae-04230cd4895e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJqNFgwG {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJqNFgwG" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d774b92-707a-4f8d-a55e-ef4bc1af27be]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJqNFgwG'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d2d0a7-1857-4b38-aef3-a717fd6b0ad6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f2f5d7-c2aa-4d0a-b395-a8b9a7a099ed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[332535af-9c01-4596-b7e0-d06fe9b48a54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]
Nov 14 08:08:12 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9144c66f-1cd1-45da-ab84-a1a34f16e295]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff4376d-70d3-4a7e-9527-9f0078d562d0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:12 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:12 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:12 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[412bb852-d9cf-441c-b7ff-6b9675983113]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26333343230663934', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333343230663934', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-282595868',display_name='tempest-ServerActionsTestOtherA-server-102191055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-282595868',id=15,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATQaebgY6FVuDzfByi4n+NZkAFhSWDDR3cOgUOfYqPhuzhPRZQAh2rqky1pom02R6jbd5n7JWx9caNElsIemhUwnvUJsbZN0JtdgFrUe+kcbMjv4SOyBmEz18HgXewRhg==',key_name='tempest-keypair-1756979960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-jrdab4sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=1a8e1fa0-e30d-4940-b08d-15cfe8b1737e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:08:13 user nova-compute[75305]:   <uuid>1a8e1fa0-e30d-4940-b08d-15cfe8b1737e</uuid>
Nov 14 08:08:13 user nova-compute[75305]:   <name>instance-0000000f</name>
Nov 14 08:08:13 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:08:13 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:08:13 user nova-compute[75305]:   <metadata>
Nov 14 08:08:13 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:08:13 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:08:13 user nova-compute[75305]:       <nova:name>tempest-ServerActionsTestOtherA-server-102191055</nova:name>
Nov 14 08:08:13 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:08:12</nova:creationTime>
Nov 14 08:08:13 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:08:13 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:08:13 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:08:13 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:08:13 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:08:13 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:08:13 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:08:13 user nova-compute[75305]:       <nova:owner>
Nov 14 08:08:13 user nova-compute[75305]:         <nova:user uuid="574c9a82a4994bdcb60c5d96b199d69a">tempest-ServerActionsTestOtherA-723782501-project-member</nova:user>
Nov 14 08:08:13 user nova-compute[75305]:         <nova:project uuid="34a93139587f4dc0b2bd586961056c6c">tempest-ServerActionsTestOtherA-723782501</nova:project>
Nov 14 08:08:13 user nova-compute[75305]:       </nova:owner>
Nov 14 08:08:13 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:08:13 user nova-compute[75305]:       <nova:ports>
Nov 14 08:08:13 user nova-compute[75305]:         <nova:port uuid="2cca97fb-fc47-47b5-a480-2082f53a52db">
Nov 14 08:08:13 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 08:08:13 user nova-compute[75305]:         </nova:port>
Nov 14 08:08:13 user nova-compute[75305]:       </nova:ports>
Nov 14 08:08:13 user nova-compute[75305]:     </nova:instance>
Nov 14 08:08:13 user nova-compute[75305]:   </metadata>
Nov 14 08:08:13 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:08:13 user nova-compute[75305]:     <system>
Nov 14 08:08:13 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:08:13 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:08:13 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:08:13 user nova-compute[75305]:       <entry name="serial">1a8e1fa0-e30d-4940-b08d-15cfe8b1737e</entry>
Nov 14 08:08:13 user nova-compute[75305]:       <entry name="uuid">1a8e1fa0-e30d-4940-b08d-15cfe8b1737e</entry>
Nov 14 08:08:13 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:08:13 user nova-compute[75305]:     </system>
Nov 14 08:08:13 user nova-compute[75305]:   </sysinfo>
Nov 14 08:08:13 user nova-compute[75305]:   <os>
Nov 14 08:08:13 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:08:13 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:08:13 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:08:13 user nova-compute[75305]:   </os>
Nov 14 08:08:13 user nova-compute[75305]:   <features>
Nov 14 08:08:13 user nova-compute[75305]:     <acpi/>
Nov 14 08:08:13 user nova-compute[75305]:     <apic/>
Nov 14 08:08:13 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:08:13 user nova-compute[75305]:   </features>
Nov 14 08:08:13 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:08:13 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:08:13 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:08:13 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:08:13 user nova-compute[75305]:   </clock>
Nov 14 08:08:13 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:08:13 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:08:13 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:08:13 user nova-compute[75305]:   </cpu>
Nov 14 08:08:13 user nova-compute[75305]:   <devices>
Nov 14 08:08:13 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:08:13 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:08:13 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk"/>
Nov 14 08:08:13 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:08:13 user nova-compute[75305]:     </disk>
Nov 14 08:08:13 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:08:13 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:13 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:08:13 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:08:13 user nova-compute[75305]:       <serial>c6570597-882f-4c7c-8d5d-b12f8552ad16</serial>
Nov 14 08:08:13 user nova-compute[75305]:     </disk>
Nov 14 08:08:13 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:08:13 user nova-compute[75305]:       <mac address="fa:16:3e:b4:e9:01"/>
Nov 14 08:08:13 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:08:13 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:08:13 user nova-compute[75305]:       <target dev="tap2cca97fb-fc"/>
Nov 14 08:08:13 user nova-compute[75305]:     </interface>
Nov 14 08:08:13 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:08:13 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/console.log" append="off"/>
Nov 14 08:08:13 user nova-compute[75305]:     </serial>
Nov 14 08:08:13 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:08:13 user nova-compute[75305]:     <video>
Nov 14 08:08:13 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:08:13 user nova-compute[75305]:     </video>
Nov 14 08:08:13 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:08:13 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:08:13 user nova-compute[75305]:     </rng>
Nov 14 08:08:13 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:08:13 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:08:13 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:08:13 user nova-compute[75305]:     </memballoon>
Nov 14 08:08:13 user nova-compute[75305]:   </devices>
Nov 14 08:08:13 user nova-compute[75305]: </domain>
Nov 14 08:08:13 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-282595868',display_name='tempest-ServerActionsTestOtherA-server-102191055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-282595868',id=15,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATQaebgY6FVuDzfByi4n+NZkAFhSWDDR3cOgUOfYqPhuzhPRZQAh2rqky1pom02R6jbd5n7JWx9caNElsIemhUwnvUJsbZN0JtdgFrUe+kcbMjv4SOyBmEz18HgXewRhg==',key_name='tempest-keypair-1756979960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-jrdab4sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:08:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=1a8e1fa0-e30d-4940-b08d-15cfe8b1737e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG os_vif [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c5e88e6-d3a9-54ed-8a7f-8b69ffaa86d7', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cca97fb-fc, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cca97fb-fc, col_values=(('qos', UUID('cf8b9c24-5608-465e-80aa-4ab32c7ed54c')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cca97fb-fc, col_values=(('external_ids', {'iface-id': '2cca97fb-fc47-47b5-a480-2082f53a52db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:e9:01', 'vm-uuid': '1a8e1fa0-e30d-4940-b08d-15cfe8b1737e'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:13 user nova-compute[75305]: INFO os_vif [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc')
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No VIF found with MAC fa:16:3e:b4:e9:01, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Starting finish_revert_migration {{(pid=75305) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Start _get_guest_xml network_info=[{"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '29e15cd6-812d-4b0a-ae2f-2aa8f98f2e9d', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace', 'attached_at': '2023-11-14T08:08:14.000000', 'detached_at': '', 'volume_id': '47c805e5-5129-493e-94e7-1fd4a5235d33', 'serial': '47c805e5-5129-493e-94e7-1fd4a5235d33'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:08:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:08:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:14 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:14 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:14 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6688a273-8649-4da5-a63b-4ec7eb2140df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:08:14 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b423b4d0-1393-4f64-a5c4-64b1acebd230]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33] added
Nov 14 08:08:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7461f141-9eb9-4c77-af45-631b637b358c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75bb833-d623-480e-93c4-af9edd89986c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFYybEUk {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vFYybEUk" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb78d86-7542-4d34-88f2-b8672881fbbd]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vFYybEUk'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7be28f8-d4fb-4d7a-875e-0f53f423d497]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[237ec549-c693-4715-b33e-0bdca9f2bf12]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75c6f16-6c96-4932-8334-216c86e0c2b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]
Nov 14 08:08:14 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbfaa3a-824a-4428-8b1b-a68d9e6dde10]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f43dba-5a93-4baf-8674-9eb7acd3ee6f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1981d552-8fba-48a8-86dd-9f1b8e77c88b]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-e4709a38-dd68-4343-9b5c-18e4bc54168a req-2a488321-b681-4a48-bff3-fbed31f1381f service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e4709a38-dd68-4343-9b5c-18e4bc54168a req-2a488321-b681-4a48-bff3-fbed31f1381f service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e4709a38-dd68-4343-9b5c-18e4bc54168a req-2a488321-b681-4a48-bff3-fbed31f1381f service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e4709a38-dd68-4343-9b5c-18e4bc54168a req-2a488321-b681-4a48-bff3-fbed31f1381f service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-e4709a38-dd68-4343-9b5c-18e4bc54168a req-2a488321-b681-4a48-bff3-fbed31f1381f service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:15 user nova-compute[75305]: WARNING nova.compute.manager [req-e4709a38-dd68-4343-9b5c-18e4bc54168a req-2a488321-b681-4a48-bff3-fbed31f1381f service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received unexpected event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with vm_state active and task_state rebuild_spawning.
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26430653834353534', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430653834353534', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:08:15 user nova-compute[75305]:   <uuid>ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</uuid>
Nov 14 08:08:15 user nova-compute[75305]:   <name>instance-00000005</name>
Nov 14 08:08:15 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:08:15 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:08:15 user nova-compute[75305]:   <metadata>
Nov 14 08:08:15 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:08:15 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:08:15 user nova-compute[75305]:       <nova:name>tempest-ServerActionsTestOtherB-server-559180561</nova:name>
Nov 14 08:08:15 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:08:14</nova:creationTime>
Nov 14 08:08:15 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:08:15 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:08:15 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:08:15 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:08:15 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:08:15 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:08:15 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:08:15 user nova-compute[75305]:       <nova:owner>
Nov 14 08:08:15 user nova-compute[75305]:         <nova:user uuid="7dda8620115b4ad5a5acc0c811ef44ee">tempest-ServerActionsTestOtherB-1488485775-project-member</nova:user>
Nov 14 08:08:15 user nova-compute[75305]:         <nova:project uuid="cd8b5236976e4be48b494cdbc69015b4">tempest-ServerActionsTestOtherB-1488485775</nova:project>
Nov 14 08:08:15 user nova-compute[75305]:       </nova:owner>
Nov 14 08:08:15 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:08:15 user nova-compute[75305]:       <nova:ports>
Nov 14 08:08:15 user nova-compute[75305]:         <nova:port uuid="9f99886b-aaf5-4e84-a5d2-2e74015f4386">
Nov 14 08:08:15 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 08:08:15 user nova-compute[75305]:         </nova:port>
Nov 14 08:08:15 user nova-compute[75305]:       </nova:ports>
Nov 14 08:08:15 user nova-compute[75305]:     </nova:instance>
Nov 14 08:08:15 user nova-compute[75305]:   </metadata>
Nov 14 08:08:15 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:08:15 user nova-compute[75305]:     <system>
Nov 14 08:08:15 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:08:15 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:08:15 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:08:15 user nova-compute[75305]:       <entry name="serial">ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</entry>
Nov 14 08:08:15 user nova-compute[75305]:       <entry name="uuid">ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace</entry>
Nov 14 08:08:15 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:08:15 user nova-compute[75305]:     </system>
Nov 14 08:08:15 user nova-compute[75305]:   </sysinfo>
Nov 14 08:08:15 user nova-compute[75305]:   <os>
Nov 14 08:08:15 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:08:15 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:08:15 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:08:15 user nova-compute[75305]:   </os>
Nov 14 08:08:15 user nova-compute[75305]:   <features>
Nov 14 08:08:15 user nova-compute[75305]:     <acpi/>
Nov 14 08:08:15 user nova-compute[75305]:     <apic/>
Nov 14 08:08:15 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:08:15 user nova-compute[75305]:   </features>
Nov 14 08:08:15 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:08:15 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:08:15 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:08:15 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:08:15 user nova-compute[75305]:   </clock>
Nov 14 08:08:15 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:08:15 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:08:15 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:08:15 user nova-compute[75305]:   </cpu>
Nov 14 08:08:15 user nova-compute[75305]:   <devices>
Nov 14 08:08:15 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:08:15 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:08:15 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk"/>
Nov 14 08:08:15 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:08:15 user nova-compute[75305]:     </disk>
Nov 14 08:08:15 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:08:15 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:15 user nova-compute[75305]:       <source dev="/dev/sdd"/>
Nov 14 08:08:15 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:08:15 user nova-compute[75305]:       <serial>47c805e5-5129-493e-94e7-1fd4a5235d33</serial>
Nov 14 08:08:15 user nova-compute[75305]:     </disk>
Nov 14 08:08:15 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:08:15 user nova-compute[75305]:       <mac address="fa:16:3e:ed:e6:07"/>
Nov 14 08:08:15 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:08:15 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:08:15 user nova-compute[75305]:       <target dev="tap9f99886b-aa"/>
Nov 14 08:08:15 user nova-compute[75305]:     </interface>
Nov 14 08:08:15 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:08:15 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/console.log" append="off"/>
Nov 14 08:08:15 user nova-compute[75305]:     </serial>
Nov 14 08:08:15 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:08:15 user nova-compute[75305]:     <video>
Nov 14 08:08:15 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:08:15 user nova-compute[75305]:     </video>
Nov 14 08:08:15 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:08:15 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:08:15 user nova-compute[75305]:     </rng>
Nov 14 08:08:15 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:08:15 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:08:15 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:08:15 user nova-compute[75305]:     </memballoon>
Nov 14 08:08:15 user nova-compute[75305]:   </devices>
Nov 14 08:08:15 user nova-compute[75305]: </domain>
Nov 14 08:08:15 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:08:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG os_vif [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '939d6e4f-8c81-5e97-aec7-8ed78d24a5cf', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f99886b-aa, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f99886b-aa, col_values=(('qos', UUID('9d232205-c3e9-49a8-8011-2b4e7fa482b4')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f99886b-aa, col_values=(('external_ids', {'iface-id': '9f99886b-aaf5-4e84-a5d2-2e74015f4386', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:e6:07', 'vm-uuid': 'ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:15 user nova-compute[75305]: INFO os_vif [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa')
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-61d920c3-edff-44e8-966f-9c178da71f68 req-cd195b21-7021-426f-8c7f-b4c7275fd0e2 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-61d920c3-edff-44e8-966f-9c178da71f68 req-cd195b21-7021-426f-8c7f-b4c7275fd0e2 service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-61d920c3-edff-44e8-966f-9c178da71f68 req-cd195b21-7021-426f-8c7f-b4c7275fd0e2 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-61d920c3-edff-44e8-966f-9c178da71f68 req-cd195b21-7021-426f-8c7f-b4c7275fd0e2 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-61d920c3-edff-44e8-966f-9c178da71f68 req-cd195b21-7021-426f-8c7f-b4c7275fd0e2 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:17 user nova-compute[75305]: WARNING nova.compute.manager [req-61d920c3-edff-44e8-966f-9c178da71f68 req-cd195b21-7021-426f-8c7f-b4c7275fd0e2 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state resized and task_state resize_reverting.
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:08:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance spawned successfully.
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-0bc4cc7e-723c-4e07-bf66-19b0a7b80be9 req-766ead83-0d13-4b4c-9904-20dbe75cc885 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0bc4cc7e-723c-4e07-bf66-19b0a7b80be9 req-766ead83-0d13-4b4c-9904-20dbe75cc885 service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0bc4cc7e-723c-4e07-bf66-19b0a7b80be9 req-766ead83-0d13-4b4c-9904-20dbe75cc885 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0bc4cc7e-723c-4e07-bf66-19b0a7b80be9 req-766ead83-0d13-4b4c-9904-20dbe75cc885 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-0bc4cc7e-723c-4e07-bf66-19b0a7b80be9 req-766ead83-0d13-4b4c-9904-20dbe75cc885 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:17 user nova-compute[75305]: WARNING nova.compute.manager [req-0bc4cc7e-723c-4e07-bf66-19b0a7b80be9 req-766ead83-0d13-4b4c-9904-20dbe75cc885 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received unexpected event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with vm_state active and task_state rebuild_spawning.
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75305) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9b8458ef-65ef-4c3e-92ff-b22d909af07b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.154s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'flavor' on Instance uuid 75e8c85d-2a8b-4eef-80ab-e0a76998509d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:18 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Ignoring supplied device name: /dev/vdb
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:18 user nova-compute[75305]: INFO nova.compute.manager [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Attaching volume 5c967f64-408e-4d9b-a199-1c5cc995b4b5 to /dev/vdb
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG os_brick.utils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[758b71f3-9c34-448a-b949-0d43cf167df2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aad0390-16e0-4c0d-b645-4d1e70091ceb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f338094-9ff2-429d-9020-1489c8d7533f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[50073e56-d39b-4557-a3f1-906c47291fbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:18 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbacba8a-b218-43ea-af21-a776549c4f58]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG os_brick.utils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updating existing volume attachment record: bebc78c2-deb8-4959-9fc9-bdb088a738c0 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-92660d88-9ce7-4d66-bf8f-f292cb446300 req-f88e7228-886f-412c-9940-d139eba4cb51 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-92660d88-9ce7-4d66-bf8f-f292cb446300 req-f88e7228-886f-412c-9940-d139eba4cb51 service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-92660d88-9ce7-4d66-bf8f-f292cb446300 req-f88e7228-886f-412c-9940-d139eba4cb51 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-92660d88-9ce7-4d66-bf8f-f292cb446300 req-f88e7228-886f-412c-9940-d139eba4cb51 service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-92660d88-9ce7-4d66-bf8f-f292cb446300 req-f88e7228-886f-412c-9940-d139eba4cb51 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:19 user nova-compute[75305]: WARNING nova.compute.manager [req-92660d88-9ce7-4d66-bf8f-f292cb446300 req-f88e7228-886f-412c-9940-d139eba4cb51 service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state resized and task_state resize_reverting.
Nov 14 08:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance running successfully.
Nov 14 08:08:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] finish_revert_migration finished successfully. {{(pid=75305) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-changed-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Refreshing instance network info cache due to event network-changed-a88fde8c-e91d-42b0-b599-801eec3ea513. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] Acquiring lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] Acquired lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG nova.network.neutron [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Refreshing network info cache for port a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:08:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:20 user nova-compute[75305]: INFO nova.compute.manager [None req-a600730b-576b-4edb-940d-f418192371b5 tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance to original state: 'active'
Nov 14 08:08:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:08:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7503MB free_disk=25.169353485107422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updated VIF entry in instance network info cache for port a88fde8c-e91d-42b0-b599-801eec3ea513. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updating instance_info_cache with network_info: [{"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-23117b59-07d2-4918-ac23-0efda509a56f req-0628f59b-892d-4de7-bfdd-b51d7e75ec30 service nova] Releasing lock "refresh_cache-75e8c85d-2a8b-4eef-80ab-e0a76998509d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5959dc8-a417-4528-9f03-3951186c2315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance c837ffe0-c080-444e-a327-a7781f6d49bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance e1bef3aa-b56f-47e3-8ab2-cf7736787326 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 10780135-d628-4567-9825-91df6d78dd22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:08:20 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:08:21 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:08:21 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:08:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:08:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.047s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-changed-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Refreshing instance network info cache due to event network-changed-9b473587-96aa-487c-b433-ec95b036b9aa. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] Acquiring lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] Acquired lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG nova.network.neutron [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Refreshing network info cache for port 9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:22 user nova-compute[75305]: DEBUG nova.objects.instance [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lazy-loading 'flavor' on Instance uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Updated VIF entry in instance network info cache for port 9b473587-96aa-487c-b433-ec95b036b9aa. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Updating instance_info_cache with network_info: [{"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:23 user nova-compute[75305]: INFO nova.compute.manager [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Attaching volume 4d05c111-8167-402a-955a-3f75ed70f428 to /dev/vdb
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-747c4034-1f8d-49fc-8616-4afa0edb7e86 req-2c66d7f3-fad2-4335-a987-18f65aa3d5a7 service nova] Releasing lock "refresh_cache-e70bba44-e95d-4685-b5ae-18ea4ff42d21" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.utils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e9aaa5-6b3e-4a16-ac42-c63ca7be6bf4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9861b2c-3698-40b9-9b4a-1baf63b0acde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd6ab39-18e2-4e24-b832-89204b06c7a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec97e50-d0e2-4afc-b17f-2507372aee7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:23 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d18f1b-b74d-407b-b822-61e91f764bfa]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.utils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Updating existing volume attachment record: 7a38df8c-5194-4036-bd96-e57226e3194b {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvFCxcys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:23 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:23 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:23 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabcdc15-4e01-4fe2-afa5-b438b43aef5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:08:23 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cb28da-a384-4f83-bf32-4e22ba1b411f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5] added
Nov 14 08:08:23 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c502f89-3d65-497a-bd53-5e46e4b4fb36]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81267759-db68-4f39-b83f-f7e03d096ac4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvFCxcys {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvFCxcys" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0163268-a21f-4cfc-8b03-0756c1e728d7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GvFCxcys'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c296924-259d-4941-aa0d-8fa15e70df16]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[365341c9-4782-4a4f-b8b0-18bea4e1f250]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:23 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:23 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:23 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:23 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:23 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:23 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[23331674-44c3-4065-ab08-376fbae2d0ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260]
Nov 14 08:08:23 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:23 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7498413d-ead4-466a-a869-2c4474d61d1c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c04e7b-885d-4b70-90de-ebfd6e4fc380]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:24 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a339f52-a7d8-4ec9-ad61-bd93013429bc]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvFCxcys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '26339663763396534', 'path': '/dev/sde'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339663763396534', 'path': '/dev/sde'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'flavor' on Instance uuid 75e8c85d-2a8b-4eef-80ab-e0a76998509d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:08:25 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:25 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:08:25 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:25 user nova-compute[75305]:   <serial>5c967f64-408e-4d9b-a199-1c5cc995b4b5</serial>
Nov 14 08:08:25 user nova-compute[75305]: </disk>
Nov 14 08:08:25 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid f6ec11ae-2f25-4285-b810-ea4009d62c59 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 75e8c85d-2a8b-4eef-80ab-e0a76998509d {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid e1bef3aa-b56f-47e3-8ab2-cf7736787326 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid d16d469c-6caf-4ba0-869e-2eb0c4908d24 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "f5959dc8-a417-4528-9f03-3951186c2315" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "10780135-d628-4567-9825-91df6d78dd22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "10780135-d628-4567-9825-91df6d78dd22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "f5959dc8-a417-4528-9f03-3951186c2315" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] No VIF found with MAC fa:16:3e:53:42:00, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b6417ac2-cfb6-4499-85a9-8d41ea5a7e61 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.409s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.290s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:28 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:28 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:28 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0dc9ab-580e-45a6-808c-356ddc29a6b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:08:28 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70bbf52-f0ee-4ed3-aaff-07de0ffc135b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428] added
Nov 14 08:08:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c494be-a496-4d89-966a-6a376996fb2a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12040ba7-2ded-44f0-9215-679e44f2b23c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cztqaQRC {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cztqaQRC" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c9e185-485f-481d-9530-f5ea70cc9d4a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cztqaQRC'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2b122-faea-4791-b8d2-dc29ba46ef74]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f321a4b-0bcd-4ca5-8336-6e545c5e66a4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[556d107c-057c-42a6-990e-dd0296b9656d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]
Nov 14 08:08:28 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81070141-0509-4c6b-a3ef-84f60e32cca0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc094eb-4a7a-4bdb-bb67-8c2d76f8a257]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:28 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] HCTL ('37', '-', '-', 0) found on session 22 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b66b79-fb3b-476c-9632-88d9c7eacd67]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Searching for a device in session 22 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26134666536303462', 'path': '/dev/sdf'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134666536303462', 'path': '/dev/sdf'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG nova.objects.instance [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lazy-loading 'flavor' on Instance uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:08:29 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:29 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:08:29 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:29 user nova-compute[75305]:   <serial>4d05c111-8167-402a-955a-3f75ed70f428</serial>
Nov 14 08:08:29 user nova-compute[75305]: </disk>
Nov 14 08:08:29 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] No VIF found with MAC fa:16:3e:5e:73:1c, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8a442833-5425-4ae7-84c1-82d1744e8d19 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.751s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.486s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing instance network info cache due to event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:08:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] Acquiring lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] Acquired lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:30 user nova-compute[75305]: DEBUG nova.network.neutron [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG os_brick.utils [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6d1f4b-2e1e-48e7-8e1a-714c8ed15f8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48861896-e0bc-43b1-b6aa-525fb2d75145]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e1d05a-fe50-4918-b153-d6058f8d0267]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f1370b-05d8-483e-ac80-de34f99bb0d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updated VIF entry in instance network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f9b2adf0-2435-457d-bf0c-f456c9a378d5 req-548450f9-4a34-4ac3-83e6-ad1d44b969fe service nova] Releasing lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:31 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:08:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0a36b-3fcb-4c34-b559-b7cd5e6414a8]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:08:31 user nova-compute[75305]: DEBUG os_brick.utils [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:31 user nova-compute[75305]: INFO nova.compute.manager [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Swapping volume 4d05c111-8167-402a-955a-3f75ed70f428 for 5591e472-e350-4c08-97f4-b3942073abf1
Nov 14 08:08:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:32 user nova-compute[75305]: INFO nova.compute.manager [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Detaching volume 5c967f64-408e-4d9b-a199-1c5cc995b4b5
Nov 14 08:08:32 user nova-compute[75305]: INFO nova.virt.block_device [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Attempting to driver detach volume 5c967f64-408e-4d9b-a199-1c5cc995b4b5 from mountpoint /dev/vdb
Nov 14 08:08:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Attempting to detach device vdb from instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:08:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:08:32 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:32 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:08:32 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:32 user nova-compute[75305]:   <serial>5c967f64-408e-4d9b-a199-1c5cc995b4b5</serial>
Nov 14 08:08:32 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:08:32 user nova-compute[75305]: </disk>
Nov 14 08:08:32 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:08:32 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully detached device vdb from instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d from the persistent domain config.
Nov 14 08:08:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:08:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:08:32 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:32 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:08:32 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:32 user nova-compute[75305]:   <serial>5c967f64-408e-4d9b-a199-1c5cc995b4b5</serial>
Nov 14 08:08:32 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:08:32 user nova-compute[75305]: </disk>
Nov 14 08:08:32 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:08:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:33 user nova-compute[75305]: INFO nova.compute.manager [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Shelving
Nov 14 08:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-e8a56f29-72ef-4849-a271-ff9633f5b170 req-61301b73-7932-463e-8a69-e7f69d47b342 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e8a56f29-72ef-4849-a271-ff9633f5b170 req-61301b73-7932-463e-8a69-e7f69d47b342 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e8a56f29-72ef-4849-a271-ff9633f5b170 req-61301b73-7932-463e-8a69-e7f69d47b342 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e8a56f29-72ef-4849-a271-ff9633f5b170 req-61301b73-7932-463e-8a69-e7f69d47b342 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-e8a56f29-72ef-4849-a271-ff9633f5b170 req-61301b73-7932-463e-8a69-e7f69d47b342 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:34 user nova-compute[75305]: WARNING nova.compute.manager [req-e8a56f29-72ef-4849-a271-ff9633f5b170 req-61301b73-7932-463e-8a69-e7f69d47b342 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state active and task_state shelving.
Nov 14 08:08:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:34 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance destroyed successfully.
Nov 14 08:08:34 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Beginning cold snapshot process
Nov 14 08:08:35 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:08:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk /opt/stack/data/nova/instances/snapshots/tmpsdfwx4f8/e64564bf055348e99e6c9daf009d75ae {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk /opt/stack/data/nova/instances/snapshots/tmpsdfwx4f8/e64564bf055348e99e6c9daf009d75ae" returned: 0 in 0.633s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Snapshot extracted, beginning image upload
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:36 user nova-compute[75305]: INFO nova.compute.manager [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Detaching volume 5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:36 user nova-compute[75305]: INFO nova.virt.block_device [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Attempting to driver detach volume 5db9188d-0523-467c-af2a-329ee663d088 from mountpoint /dev/vdb
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Attempting to detach device vdb from instance f5959dc8-a417-4528-9f03-3951186c2315 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:08:36 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:36 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:08:36 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:36 user nova-compute[75305]:   <serial>5db9188d-0523-467c-af2a-329ee663d088</serial>
Nov 14 08:08:36 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:08:36 user nova-compute[75305]: </disk>
Nov 14 08:08:36 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:08:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Successfully detached device vdb from instance f5959dc8-a417-4528-9f03-3951186c2315 from the persistent domain config.
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5959dc8-a417-4528-9f03-3951186c2315 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:08:36 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:36 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:08:36 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:36 user nova-compute[75305]:   <serial>5db9188d-0523-467c-af2a-329ee663d088</serial>
Nov 14 08:08:36 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:08:36 user nova-compute[75305]: </disk>
Nov 14 08:08:36 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-b650a9b3-60bf-42b0-911e-7b2ac9ca83f1 req-f69c3bd5-b674-4f2b-ac17-fb6e5adc023d service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b650a9b3-60bf-42b0-911e-7b2ac9ca83f1 req-f69c3bd5-b674-4f2b-ac17-fb6e5adc023d service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b650a9b3-60bf-42b0-911e-7b2ac9ca83f1 req-f69c3bd5-b674-4f2b-ac17-fb6e5adc023d service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b650a9b3-60bf-42b0-911e-7b2ac9ca83f1 req-f69c3bd5-b674-4f2b-ac17-fb6e5adc023d service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-b650a9b3-60bf-42b0-911e-7b2ac9ca83f1 req-f69c3bd5-b674-4f2b-ac17-fb6e5adc023d service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:36 user nova-compute[75305]: WARNING nova.compute.manager [req-b650a9b3-60bf-42b0-911e-7b2ac9ca83f1 req-f69c3bd5-b674-4f2b-ac17-fb6e5adc023d service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJwSMtvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e70bba44-e95d-4685-b5ae-18ea4ff42d21', 'attached_at': '', 'detached_at': '', 'volume_id': '5591e472-e350-4c08-97f4-b3942073abf1', 'serial': '5591e472-e350-4c08-97f4-b3942073abf1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e70bba44-e95d-4685-b5ae-18ea4ff42d21', 'attached_at': '', 'detached_at': '', 'volume_id': '4d05c111-8167-402a-955a-3f75ed70f428', 'serial'} {{(pid=75305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJwSMtvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:36 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:36 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:36 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e802da-111a-4097-8ebf-fd2d3be889b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:08:36 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[14477921-9523-471d-9558-0bd67906b665]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1] added
Nov 14 08:08:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c626de2c-d649-4531-8973-2a487d9f7394]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab545e26-e7fb-4c30-bb04-1f04a24da8ad]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJwSMtvU {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJwSMtvU" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c807e79-e601-4bf0-a1f4-4d981b1871ae]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJwSMtvU'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7f81c2-7e91-4809-a45c-abf25d829263]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2eea67-b7dd-4791-8ca2-470d58c75b02]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29fb22d-a2ea-49e7-8094-27a997422dac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260]
Nov 14 08:08:36 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6da51b-0bfa-4a30-ae95-a23d658b00ec]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7f35d6-eee3-417a-be74-21009308b3b2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:36 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[63df1359-d73d-4ccb-ae1d-61cba3bfc8da]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:37 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJwSMtvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:08:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] <== connect_volume: return (1468ms) {'type': 'block', 'scsi_wwn': '23236366132616364', 'path': '/dev/sdg'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236366132616364', 'path': '/dev/sdg'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:08:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lazy-loading 'flavor' on Instance uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Snapshot image upload complete
Nov 14 08:08:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:38 user nova-compute[75305]: INFO nova.compute.manager [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Shelve offloading
Nov 14 08:08:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance destroyed successfully.
Nov 14 08:08:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquired lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Releasing lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 337641472 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:39 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance destroyed successfully.
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'resources' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-113716200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-113716200',id=18,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDoRF2EW+47Bp/aN3W1QZH6tyM1NlPXatd3hRlKIaElGDLN0se+vBXrBadawHdZo2kVdF6J1fpDCAGug/K7mO/BFgTr9VzotrFDcpPoWS/24a8nUL9bsxRSJuRfbdhug==',key_name='tempest-keypair-146649035',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-obbnhka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member',shelved_at='2023-11-14T08:08:38.242532',shelved_host='user',shelved_image_id='f1ba9c6b-2b8d-42aa-9882-134354a66656'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=c837ffe0-c080-444e-a327-a7781f6d49bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG os_vif [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fc26dc0-37, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing instance network info cache due to event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] Acquiring lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] Acquired lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.network.neutron [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcbc387f-28fe-4d14-b8f8-4b8c1e66b2fe) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:39 user nova-compute[75305]: INFO os_vif [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37')
Nov 14 08:08:39 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Deleting instance files /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc_del
Nov 14 08:08:39 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Deletion of /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc_del complete
Nov 14 08:08:39 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Deleted allocations for instance c837ffe0-c080-444e-a327-a7781f6d49bc
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 510656512 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'numa_topology' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:39 user nova-compute[75305]: DEBUG nova.objects.base [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<c837ffe0-c080-444e-a327-a7781f6d49bc> lazy-loaded attributes: resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updated VIF entry in instance network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4582764b-b155-4ac5-9d12-8af31c7f9346 req-12aa489d-05b4-47ce-8587-e771b9e94b9e service nova] Releasing lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 684720128 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c8d4eb98-9082-4832-97dd-b1d2a7aa1bd4 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.611s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 848297984 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:42 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcbe03b-8146-46cf-8482-850680d1dd5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:42 user nova-compute[75305]: No targets found.
Nov 14 08:08:42 user nova-compute[75305]: iSNS:
Nov 14 08:08:42 user nova-compute[75305]: No targets found.
Nov 14 08:08:42 user nova-compute[75305]: STATIC:
Nov 14 08:08:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5
Nov 14 08:08:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:08:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1
Nov 14 08:08:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:42 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:08:42 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:42 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:42 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:42 user nova-compute[75305]: No targets found.
Nov 14 08:08:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:42 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:42 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c95cf7b-b560-43e8-8224-ae840367f237]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ea60fe-0b29-4710-befd-f35d2ef9b304]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf44692e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428'): ({'sdf'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Removing single pathed devices sdf {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108dfb4-3cfd-4141-ae76-dc1bdb69258b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6100bc-0530-46f9-a85f-fe9808c08844]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Flushing IO for device /dev/sdf {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ee40ef-0313-4d1d-ac86-f66133f078ee]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db1946f-b3d2-45d4-bc54-9360328ad716]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbabb53-29c8-49a9-882f-ce7e3b8971f7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57942711-ba2e-43f6-b4ef-61f01fe7908c]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]
Nov 14 08:08:42 user nova-compute[75305]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf325dc-4c9e-4cb3-9bf1-cebed9127fe6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] <== disconnect_volume: return (317ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJwSMtvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'e70bba44-e95d-4685-b5ae-18ea4ff42d21', 'attached_at': '', 'detached_at': '', 'volume_id': '5591e472-e350-4c08-97f4-b3942073abf1', 'serial'} {{(pid=75305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 08:08:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] swap_volume: removing Cinder connection for volume 4d05c111-8167-402a-955a-3f75ed70f428 {{(pid=75305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] swap_volume: Updating volume 4d05c111-8167-402a-955a-3f75ed70f428 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KJwSMtvU", "auth_password": "rmnaGC6kD0sFwh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "5591e472-e350-4c08-97f4-b3942073abf1"}, "status": "reserved", "instance": "e70bba44-e95d-4685-b5ae-18ea4ff42d21", "attached_at": "", "detached_at": "", "volume_id": "5591e472-e350-4c08-97f4-b3942073abf1", "serial": "5591e472-e350-4c08-97f4-b3942073abf1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5591e472-e350-4c08-97f4-b3942073abf1', 'no_device': None, 'attachment_id': 'fc326d4d-0868-4509-be63-f56a571df8e2'} {{(pid=75305) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-83fd3eed-17dd-42bb-b60e-d42279636a77 tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.690s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG os_brick.utils [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a1df1e-c970-488b-8a20-4feffa2c3e76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e644ddfc-a8d6-4047-bed3-b3551ef3e3ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a2eb72-78dc-48c5-99c7-28db4f0263ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e86b29-6357-44a5-a54f-a0bda6df33db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:43 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:08:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69d13ed-2145-4778-9e83-4f126f9133a0]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:08:43 user nova-compute[75305]: DEBUG os_brick.utils [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:43 user nova-compute[75305]: INFO nova.compute.manager [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Swapping volume 5591e472-e350-4c08-97f4-b3942073abf1 for 4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:08:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e70bba44-e95d-4685-b5ae-18ea4ff42d21', 'attached_at': '', 'detached_at': '', 'volume_id': '4d05c111-8167-402a-955a-3f75ed70f428', 'serial': '4d05c111-8167-402a-955a-3f75ed70f428'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJwSMtvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '5591e472-e350-4c08-97f4-b3942073abf1'}, 'status': 'reserved', 'instance': 'e70bba44-e95d-4685-b5ae-18ea4ff42d21', 'attached_at': '', 'detached_at': '', 'volume_id': '5591e472-e350-4c08-97f4-b3942073abf1', 'serial'} {{(pid=75305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:48 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:48 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:48 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a819f6-f5ae-42a0-90c7-3f6425e8ddc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:08:48 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec55a040-d001-4795-9105-3fe107022724]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428] added
Nov 14 08:08:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b52f4a-09e7-49ba-a056-1b0b1f7a52cc]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a989d4-d5b0-407c-be64-b2b175035092]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cztqaQRC {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cztqaQRC" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68ecd5c-6cb7-4b0b-a068-ac0dfffa173f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cztqaQRC'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa0cabe-2aa1-4c88-8fec-38238dab9e37]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ed0c31-2de3-4d7e-a45d-c173e4d70bed]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e944ca3b-a0ba-4737-9dc8-cf7700a78996]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]
Nov 14 08:08:48 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48ea3c7-7fa2-4d2c-bbe5-d5ad1c4a8d08]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e006d5a1-a107-4604-b141-5acbd23a042e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8bf835-d07d-4801-b7cd-0bad2bb5f64f]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:49 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:08:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:08:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26134666536303462', 'path': '/dev/sdf'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134666536303462', 'path': '/dev/sdf'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:08:49 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lazy-loading 'flavor' on Instance uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 127926272 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 285212672 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 455081984 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 645922816 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:08:52 user nova-compute[75305]: INFO nova.compute.claims [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Claim successful on node user
Nov 14 08:08:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d is timed out.
Nov 14 08:08:52 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully detached device vdb from instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d from the live domain config.
Nov 14 08:08:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvFCxcys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:52 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d63debc-62a2-4c6f-bec1-29c4867f1ceb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:52 user nova-compute[75305]: No targets found.
Nov 14 08:08:52 user nova-compute[75305]: iSNS:
Nov 14 08:08:52 user nova-compute[75305]: No targets found.
Nov 14 08:08:52 user nova-compute[75305]: STATIC:
Nov 14 08:08:52 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5
Nov 14 08:08:52 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:52 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:52 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:52 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:52 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:52 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:52 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:52 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:52 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:08:52 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:52 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:52 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1
Nov 14 08:08:52 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:52 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:52 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:08:52 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:52 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:52 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:52 user nova-compute[75305]: No targets found.
Nov 14 08:08:52 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:52 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:52 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21007535-f713-4dcb-b322-6c4fdc2951bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11880b55-846a-4fd8-a385-803c1d87291c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:52 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4410d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5'): ({'sde'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Removing single pathed devices sde {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 817889280 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c135e48-222d-473e-8625-99c05d7a9fd4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8782a66-2bd7-4839-b58f-56d4cd4ba9b9]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Flushing IO for device /dev/sde {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da47d9-9e14-46bf-9d5f-26884f479bde]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de01527-9b99-421d-976a-e7a57b2a3ffe]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b3b0f2-77ab-4510-8c30-20bab2dbeeb3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf6e32-e211-4755-a85f-f61c0a20571f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260]
Nov 14 08:08:53 user nova-compute[75305]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:53 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[010080cf-4541-47b5-b9ab-591fa0b66f02]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== disconnect_volume: return (369ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.660s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:08:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 979369984 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.policy [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6921b8792c4b4f098ee61c6d8bc840c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeba260be7f045959c391eb65633be89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:08:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Creating image(s)
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "/opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.209s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk 1073741824" returned: 0 in 0.071s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Successfully created port: 3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:08:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJwSMtvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '5591e472-e350-4c08-97f4-b3942073abf1'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:54 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93abcbe-cbbc-459a-906d-87bf584b8e63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:54 user nova-compute[75305]: No targets found.
Nov 14 08:08:54 user nova-compute[75305]: iSNS:
Nov 14 08:08:54 user nova-compute[75305]: No targets found.
Nov 14 08:08:54 user nova-compute[75305]: STATIC:
Nov 14 08:08:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:08:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1
Nov 14 08:08:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:08:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:54 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:54 user nova-compute[75305]: No targets found.
Nov 14 08:08:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:54 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:54 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c1dd1-a1c9-445e-b1a7-4cda729a45ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4752dc0-9a25-4e62-99f0-565aa2fde1f7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5e5e3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1'): ({'sdg'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Removing single pathed devices sdg {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.objects.instance [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'flavor' on Instance uuid 75e8c85d-2a8b-4eef-80ab-e0a76998509d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de2f5e5-b7f1-4c64-9198-306fdaca9b54]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e0a18-8aff-45d4-ab3d-befe5464626b]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Flushing IO for device /dev/sdg {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb83a23-720a-4412-92bf-9f32b98873b0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71c5dfe4-2bd6-41ec-b985-826d01b7b894 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.051s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.915s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:54 user nova-compute[75305]: INFO nova.compute.manager [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Terminating instance
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f23ae7-8967-4c49-9941-7e9f03e173ea]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] SCSI volumes sdg have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e669f63d-650f-4603-8bac-93f3c24b78a3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Cannot resize image /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Ensure instance console log exists: /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e448f61-63bb-4880-805e-f1d8c6f51b4b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260]
Nov 14 08:08:54 user nova-compute[75305]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5591e472-e350-4c08-97f4-b3942073abf1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.065s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ebd658-3914-45c5-b6ed-f9911fcb25c8]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] <== disconnect_volume: return (415ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'e70bba44-e95d-4685-b5ae-18ea4ff42d21', 'attached_at': '', 'detached_at': '', 'volume_id': '4d05c111-8167-402a-955a-3f75ed70f428', 'serial'} {{(pid=75305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] swap_volume: removing Cinder connection for volume 5591e472-e350-4c08-97f4-b3942073abf1 {{(pid=75305) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-629255e0-eea1-4593-a786-8c76d047dbd5 req-d0bf0240-8062-42a8-bdb0-122e1aaa09b4 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-unplugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-629255e0-eea1-4593-a786-8c76d047dbd5 req-d0bf0240-8062-42a8-bdb0-122e1aaa09b4 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-629255e0-eea1-4593-a786-8c76d047dbd5 req-d0bf0240-8062-42a8-bdb0-122e1aaa09b4 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-629255e0-eea1-4593-a786-8c76d047dbd5 req-d0bf0240-8062-42a8-bdb0-122e1aaa09b4 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-629255e0-eea1-4593-a786-8c76d047dbd5 req-d0bf0240-8062-42a8-bdb0-122e1aaa09b4 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-unplugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-629255e0-eea1-4593-a786-8c76d047dbd5 req-d0bf0240-8062-42a8-bdb0-122e1aaa09b4 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-unplugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Instance destroyed successfully.
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lazy-loading 'resources' on Instance uuid 75e8c85d-2a8b-4eef-80ab-e0a76998509d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Successfully updated port: 3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2101402344',display_name='tempest-VolumesSnapshotTestJSON-instance-2101402344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2101402344',id=16,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJbLSjT+vHB+y2vliaLvXAgWM4/CuaAhpf4RY53BnnqPoKdyshX8a+T9SDTHB9pJHJtV75tDW1yHlRqmoz47ItwKPu00wURhrP76S+HO7lxMYZABT0CZ3T7LIiOpLWQxA==',key_name='tempest-keypair-1415231870',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='45dc68f3d5354a06905843816164c441',ramdisk_id='',reservation_id='r-vde9bdcs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-109737474',owner_user_name='tempest-VolumesSnapshotTestJSON-109737474-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:06:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c331473d0aef488fa1dd92543749f50e',uuid=75e8c85d-2a8b-4eef-80ab-e0a76998509d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converting VIF {"id": "a88fde8c-e91d-42b0-b599-801eec3ea513", "address": "fa:16:3e:53:42:00", "network": {"id": "3140738f-9593-4ba5-b058-eac9deaece40", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1070184998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "45dc68f3d5354a06905843816164c441", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa88fde8c-e9", "ovs_interfaceid": "a88fde8c-e91d-42b0-b599-801eec3ea513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:42:00,bridge_name='br-int',has_traffic_filtering=True,id=a88fde8c-e91d-42b0-b599-801eec3ea513,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88fde8c-e9') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_vif [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:42:00,bridge_name='br-int',has_traffic_filtering=True,id=a88fde8c-e91d-42b0-b599-801eec3ea513,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88fde8c-e9') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa88fde8c-e9, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquired lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=958c5637-fd18-49e8-b9c1-587225cc34f6) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: INFO os_vif [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:42:00,bridge_name='br-int',has_traffic_filtering=True,id=a88fde8c-e91d-42b0-b599-801eec3ea513,network=Network(3140738f-9593-4ba5-b058-eac9deaece40),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa88fde8c-e9')
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvFCxcys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:55 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16a86b7-57cc-41f6-b459-bfdd766eacca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:55 user nova-compute[75305]: No targets found.
Nov 14 08:08:55 user nova-compute[75305]: iSNS:
Nov 14 08:08:55 user nova-compute[75305]: No targets found.
Nov 14 08:08:55 user nova-compute[75305]: STATIC:
Nov 14 08:08:55 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:55 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:55 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:55 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:55 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:55 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:55 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:08:55 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:55 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:55 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:08:55 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:55 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:55 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:55 user nova-compute[75305]: No targets found.
Nov 14 08:08:55 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:55 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:55 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c967f64-408e-4d9b-a199-1c5cc995b4b5', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cb7ef3-66a4-4119-b54e-84d60feab23c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3363cf6-e9af-483e-8a02-0e61a53e106e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:55 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf207065f0>, {}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Disconnecting from: [] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] <== disconnect_volume: return (98ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:55 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Deleting instance files /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d_del
Nov 14 08:08:55 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Deletion of /opt/stack/data/nova/instances/75e8c85d-2a8b-4eef-80ab-e0a76998509d_del complete
Nov 14 08:08:55 user nova-compute[75305]: INFO nova.compute.manager [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] swap_volume: Updating volume 5591e472-e350-4c08-97f4-b3942073abf1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "cztqaQRC", "auth_password": "sSkNMZDHKAlgdY", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "4d05c111-8167-402a-955a-3f75ed70f428"}, "status": "reserved", "instance": "e70bba44-e95d-4685-b5ae-18ea4ff42d21", "attached_at": "", "detached_at": "", "volume_id": "4d05c111-8167-402a-955a-3f75ed70f428", "serial": "4d05c111-8167-402a-955a-3f75ed70f428"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4d05c111-8167-402a-955a-3f75ed70f428', 'no_device': None, 'attachment_id': '23bbd635-aa8b-4a21-b177-aff4aae060be'} {{(pid=75305) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3984ab95-69af-477d-8263-0be468bf6ada tempest-TestVolumeSwap-1183887269 tempest-TestVolumeSwap-1183887269-project-admin] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.658s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Updating instance_info_cache with network_info: [{"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Releasing lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Instance network_info: |[{"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Start _get_guest_xml network_info=[{"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:08:55 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:08:55 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1832998008',display_name='tempest-AttachVolumeNegativeTest-server-1832998008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1832998008',id=22,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXjspqqcejR3vk1n0Sc/DQDcrucBgqqBg1qdM2Lva/uaW/DwbsyOZ1ppHXdihHMhqYQHFL2b0yofaE+omoM1VE7c3LT2AO/rvtH2s8/qTZyANZ2KDI5AL56Dd/Z7gd6A==',key_name='tempest-keypair-1751268248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-4n8bl1pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=b495d719-82f6-48e8-9536-656d2f5513d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c72ad8f-dd') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'pci_devices' on Instance uuid b495d719-82f6-48e8-9536-656d2f5513d3 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:08:55 user nova-compute[75305]:   <uuid>b495d719-82f6-48e8-9536-656d2f5513d3</uuid>
Nov 14 08:08:55 user nova-compute[75305]:   <name>instance-00000016</name>
Nov 14 08:08:55 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:08:55 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:08:55 user nova-compute[75305]:   <metadata>
Nov 14 08:08:55 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:08:55 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:08:55 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1832998008</nova:name>
Nov 14 08:08:55 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:08:55</nova:creationTime>
Nov 14 08:08:55 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:08:55 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:08:55 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:08:55 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:08:55 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:08:55 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:08:55 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:08:55 user nova-compute[75305]:       <nova:owner>
Nov 14 08:08:55 user nova-compute[75305]:         <nova:user uuid="6921b8792c4b4f098ee61c6d8bc840c9">tempest-AttachVolumeNegativeTest-1514251643-project-member</nova:user>
Nov 14 08:08:55 user nova-compute[75305]:         <nova:project uuid="aeba260be7f045959c391eb65633be89">tempest-AttachVolumeNegativeTest-1514251643</nova:project>
Nov 14 08:08:55 user nova-compute[75305]:       </nova:owner>
Nov 14 08:08:55 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:08:55 user nova-compute[75305]:       <nova:ports>
Nov 14 08:08:55 user nova-compute[75305]:         <nova:port uuid="3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd">
Nov 14 08:08:55 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 08:08:55 user nova-compute[75305]:         </nova:port>
Nov 14 08:08:55 user nova-compute[75305]:       </nova:ports>
Nov 14 08:08:55 user nova-compute[75305]:     </nova:instance>
Nov 14 08:08:55 user nova-compute[75305]:   </metadata>
Nov 14 08:08:55 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:08:55 user nova-compute[75305]:     <system>
Nov 14 08:08:55 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:08:55 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:08:55 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:08:55 user nova-compute[75305]:       <entry name="serial">b495d719-82f6-48e8-9536-656d2f5513d3</entry>
Nov 14 08:08:55 user nova-compute[75305]:       <entry name="uuid">b495d719-82f6-48e8-9536-656d2f5513d3</entry>
Nov 14 08:08:55 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:08:55 user nova-compute[75305]:     </system>
Nov 14 08:08:55 user nova-compute[75305]:   </sysinfo>
Nov 14 08:08:55 user nova-compute[75305]:   <os>
Nov 14 08:08:55 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:08:55 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:08:55 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:08:55 user nova-compute[75305]:   </os>
Nov 14 08:08:55 user nova-compute[75305]:   <features>
Nov 14 08:08:55 user nova-compute[75305]:     <acpi/>
Nov 14 08:08:55 user nova-compute[75305]:     <apic/>
Nov 14 08:08:55 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:08:55 user nova-compute[75305]:   </features>
Nov 14 08:08:55 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:08:55 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:08:55 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:08:55 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:08:55 user nova-compute[75305]:   </clock>
Nov 14 08:08:55 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:08:55 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:08:55 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:08:55 user nova-compute[75305]:   </cpu>
Nov 14 08:08:55 user nova-compute[75305]:   <devices>
Nov 14 08:08:55 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:08:55 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:08:55 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk"/>
Nov 14 08:08:55 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:08:55 user nova-compute[75305]:     </disk>
Nov 14 08:08:55 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:08:55 user nova-compute[75305]:       <mac address="fa:16:3e:de:98:5e"/>
Nov 14 08:08:55 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:08:55 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:08:55 user nova-compute[75305]:       <target dev="tap3c72ad8f-dd"/>
Nov 14 08:08:55 user nova-compute[75305]:     </interface>
Nov 14 08:08:55 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:08:55 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/console.log" append="off"/>
Nov 14 08:08:55 user nova-compute[75305]:     </serial>
Nov 14 08:08:55 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:08:55 user nova-compute[75305]:     <video>
Nov 14 08:08:55 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:08:55 user nova-compute[75305]:     </video>
Nov 14 08:08:55 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:08:55 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:08:55 user nova-compute[75305]:     </rng>
Nov 14 08:08:55 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:08:55 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:08:55 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:08:55 user nova-compute[75305]:     </memballoon>
Nov 14 08:08:55 user nova-compute[75305]:   </devices>
Nov 14 08:08:55 user nova-compute[75305]: </domain>
Nov 14 08:08:55 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1832998008',display_name='tempest-AttachVolumeNegativeTest-server-1832998008',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1832998008',id=22,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXjspqqcejR3vk1n0Sc/DQDcrucBgqqBg1qdM2Lva/uaW/DwbsyOZ1ppHXdihHMhqYQHFL2b0yofaE+omoM1VE7c3LT2AO/rvtH2s8/qTZyANZ2KDI5AL56Dd/Z7gd6A==',key_name='tempest-keypair-1751268248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-4n8bl1pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:08:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=b495d719-82f6-48e8-9536-656d2f5513d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c72ad8f-dd') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG os_vif [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c72ad8f-dd') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c8b6e99-cef5-5d48-acfc-06f84ed7ca53', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c72ad8f-dd, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c72ad8f-dd, col_values=(('qos', UUID('7599768d-3e01-4628-aa09-900e55807d3f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c72ad8f-dd, col_values=(('external_ids', {'iface-id': '3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:98:5e', 'vm-uuid': 'b495d719-82f6-48e8-9536-656d2f5513d3'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:55 user nova-compute[75305]: INFO os_vif [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c72ad8f-dd')
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No VIF found with MAC fa:16:3e:de:98:5e, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:55 user nova-compute[75305]: DEBUG nova.objects.instance [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lazy-loading 'flavor' on Instance uuid e1bef3aa-b56f-47e3-8ab2-cf7736787326 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Took 0.78 seconds to deallocate network for instance.
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-612b9ee1-7d27-4fce-b8eb-1ac8f55cd069 req-035e9aca-61c3-4db5-92c6-5dbf10c9f7b7 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-deleted-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.compute.manager [req-612b9ee1-7d27-4fce-b8eb-1ac8f55cd069 req-035e9aca-61c3-4db5-92c6-5dbf10c9f7b7 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Neutron deleted interface a88fde8c-e91d-42b0-b599-801eec3ea513; detaching it from the instance and deleting it from the info cache
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-612b9ee1-7d27-4fce-b8eb-1ac8f55cd069 req-035e9aca-61c3-4db5-92c6-5dbf10c9f7b7 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:56 user nova-compute[75305]: WARNING nova.volume.cinder [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Attachment bebc78c2-deb8-4959-9fc9-bdb088a738c0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bebc78c2-deb8-4959-9fc9-bdb088a738c0. (HTTP 404) (Request-ID: req-7e8ff079-1455-43b7-b9e3-9bf44f36dc3e)
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.compute.manager [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-612b9ee1-7d27-4fce-b8eb-1ac8f55cd069 req-035e9aca-61c3-4db5-92c6-5dbf10c9f7b7 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Detach interface failed, port_id=a88fde8c-e91d-42b0-b599-801eec3ea513, reason: Instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.compute.manager [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Detaching volume 4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.compute.manager [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Attaching volume c4e1a6c3-bc2f-491d-8090-ca2246ab368b to /dev/vdb
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.virt.block_device [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Attempting to driver detach volume 4d05c111-8167-402a-955a-3f75ed70f428 from mountpoint /dev/vdb
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Attempting to detach device vdb from instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:08:56 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:56 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:08:56 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:56 user nova-compute[75305]:   <serial>4d05c111-8167-402a-955a-3f75ed70f428</serial>
Nov 14 08:08:56 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:08:56 user nova-compute[75305]: </disk>
Nov 14 08:08:56 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Successfully detached device vdb from instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 from the persistent domain config.
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:08:56 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:08:56 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:08:56 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:08:56 user nova-compute[75305]:   <serial>4d05c111-8167-402a-955a-3f75ed70f428</serial>
Nov 14 08:08:56 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:08:56 user nova-compute[75305]: </disk>
Nov 14 08:08:56 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.utils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c366e-195b-43d7-871c-c0c2f78dbec4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05574e57-52b7-43df-9696-a01c070d85fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7902f5-2699-4e49-b2f5-9748b11b1425]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[61991cc2-3d2e-41df-b295-40343788fa5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:08:56 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45fa398-8fdd-43af-8b3e-8d3614cbf947]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.utils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Updating existing volume attachment record: 5cb5ef89-1a54-4922-ae7c-79195182aece {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:08:56 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5959dc8-a417-4528-9f03-3951186c2315 is timed out.
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Successfully detached device vdb from instance f5959dc8-a417-4528-9f03-3951186c2315 from the live domain config.
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWEaTcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:08:56 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Deleted allocations for instance 75e8c85d-2a8b-4eef-80ab-e0a76998509d
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[267cf98c-c647-4904-a2e0-3bc30d1ab54d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:08:56 user nova-compute[75305]: No targets found.
Nov 14 08:08:56 user nova-compute[75305]: iSNS:
Nov 14 08:08:56 user nova-compute[75305]: No targets found.
Nov 14 08:08:56 user nova-compute[75305]: STATIC:
Nov 14 08:08:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088
Nov 14 08:08:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:08:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:08:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:08:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:08:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:08:56 user nova-compute[75305]: FIRMWARE:
Nov 14 08:08:56 user nova-compute[75305]: No targets found.
Nov 14 08:08:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:08:56 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:08:56 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f999ddf-d839-47b2-9e77-8f16b2c5fb02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5d1a16-054e-4263-b8bf-b6cd98eb3265]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:08:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5f1d2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:56 user nova-compute[75305]: WARNING nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received unexpected event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with vm_state deleted and task_state None.
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-changed-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Refreshing instance network info cache due to event network-changed-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Acquiring lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Acquired lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Refreshing network info cache for port 3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eb0e31-7f50-434f-a1d7-cd0fa0228018]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d978c74a-96f6-4bd0-9908-d0b8110b5515 tempest-VolumesSnapshotTestJSON-109737474 tempest-VolumesSnapshotTestJSON-109737474-project-member] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.526s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73a004f-3276-4158-9996-aee21475b8c2]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dc285f-1259-484a-a4bc-d5ef94e261cd]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b0e7a0-f364-4a41-a8b2-b23e1d581530]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3a7d98-c846-49ff-ae01-dcde00cfd1a3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ec1f3f-6641-4c95-8ffc-6c7f5d5857c2]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260]
Nov 14 08:08:56 user nova-compute[75305]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088, portal: 172.16.0.220,3260] successful.
Nov 14 08:08:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5db9188d-0523-467c-af2a-329ee663d088 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6bc499-70c4-4bfc-8958-e691da2f70e1]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] <== disconnect_volume: return (329ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:08:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.network.neutron [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Updated VIF entry in instance network info cache for port 3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.network.neutron [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Updating instance_info_cache with network_info: [{"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Releasing lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:57 user nova-compute[75305]: WARNING nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received unexpected event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with vm_state deleted and task_state None.
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:57 user nova-compute[75305]: WARNING nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received unexpected event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with vm_state deleted and task_state None.
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-unplugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-unplugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:57 user nova-compute[75305]: WARNING nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received unexpected event network-vif-unplugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with vm_state deleted and task_state None.
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Acquiring lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] Lock "75e8c85d-2a8b-4eef-80ab-e0a76998509d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] No waiting events found dispatching network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:57 user nova-compute[75305]: WARNING nova.compute.manager [req-891a0409-0540-4304-8852-bc089dfde264 req-c1572e8c-04f4-4e6e-88b5-ad4ea09611b1 service nova] [instance: 75e8c85d-2a8b-4eef-80ab-e0a76998509d] Received unexpected event network-vif-plugged-a88fde8c-e91d-42b0-b599-801eec3ea513 for instance with vm_state deleted and task_state None.
Nov 14 08:08:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'flavor' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:08:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2ac4579d-b4ff-4718-9b1e-ee80f7997801 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.661s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] No waiting events found dispatching network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:58 user nova-compute[75305]: WARNING nova.compute.manager [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received unexpected event network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd for instance with vm_state building and task_state spawning.
Nov 14 08:08:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:08:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] No waiting events found dispatching network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:08:58 user nova-compute[75305]: WARNING nova.compute.manager [req-b882ba91-07d6-4e1e-adaf-dfb77b3796b2 req-fd4a9180-663f-403e-93a1-04de95b6b22a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received unexpected event network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd for instance with vm_state building and task_state spawning.
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:08:59 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Instance spawned successfully.
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:08:59 user nova-compute[75305]: INFO nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 14 08:08:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:08:59 user nova-compute[75305]: INFO nova.compute.manager [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Took 7.29 seconds to build instance.
Nov 14 08:08:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f5ecfce2-2463-41f1-a242-9e7c67b7912b tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.439s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwuALmHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:09:00 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:00 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:00 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f59f77d-810a-4918-b961-d643baaeaeb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:09:00 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7102884b-4de4-458a-855e-c99751b74ae7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b] added
Nov 14 08:09:00 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6920928f-0dc4-45b1-896c-499cfe74eb44]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[700fb0f5-d61b-44e0-b2bb-30c963f6c8d9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwuALmHr {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bwuALmHr" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae623ceb-1e03-4e9c-a2dd-0681eb183e69]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bwuALmHr'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[942e0f5b-563e-48de-8681-9b986eef9b16]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc27e69c-3789-4688-8c6d-53ab4b35cadd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd346b6-17bc-4287-84c0-1c009d2a67e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260]
Nov 14 08:09:01 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260] successful.
Nov 14 08:09:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab4969-7cd3-4fea-a231-3e71d2361b1c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e538480a-d1e7-4dbf-9d6b-00dd8378bfd5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b (non-flash)
Nov 14 08:09:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:01 user nova-compute[75305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b (non-flash)
Nov 14 08:09:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[78085f84-1b54-445c-821d-45b69186f4c0]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:01 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwuALmHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26563623934306533', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563623934306533', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lazy-loading 'flavor' on Instance uuid e1bef3aa-b56f-47e3-8ab2-cf7736787326 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:09:02 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:09:02 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:09:02 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:09:02 user nova-compute[75305]:   <serial>c4e1a6c3-bc2f-491d-8090-ca2246ab368b</serial>
Nov 14 08:09:02 user nova-compute[75305]: </disk>
Nov 14 08:09:02 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'flavor' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:09:02 user nova-compute[75305]: INFO nova.compute.manager [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] instance snapshotting
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:02 user nova-compute[75305]: INFO nova.compute.manager [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Attaching volume 57d5a02e-0d68-452c-8d13-6ffeb3976185 to /dev/vdb
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] No VIF found with MAC fa:16:3e:1f:69:31, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:09:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Beginning live snapshot process
Nov 14 08:09:02 user nova-compute[75305]: DEBUG os_brick.utils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b77763-df65-47c6-a54e-8a38974f3f29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d2c14-bd5b-4b07-ae83-b9c55a0724aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db68dd9-15f0-4860-8cc5-90544f571615]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83eebdd-36a5-4700-a0de-c00e04c17685]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:09:03 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[293610a1-0665-4cf8-9473-970fbf0e435b]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-04a95510-3d7a-48bc-bf4e-e6fe40944293 tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.836s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG os_brick.utils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating existing volume attachment record: 0713c30f-c18b-4c00-af84-1df142afab32 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc3oz7h7f/9be8d567573c4f149c867aec718e6bcf.delta 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc3oz7h7f/9be8d567573c4f149c867aec718e6bcf.delta 1073741824" returned: 0 in 0.045s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:03 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:04 user nova-compute[75305]: INFO nova.compute.manager [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Terminating instance
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8dd2aec-4009-48ca-b9ba-1849435af1c5 req-51c92825-04a5-4bef-8c04-a396b55d3525 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received event network-vif-unplugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8dd2aec-4009-48ca-b9ba-1849435af1c5 req-51c92825-04a5-4bef-8c04-a396b55d3525 service nova] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8dd2aec-4009-48ca-b9ba-1849435af1c5 req-51c92825-04a5-4bef-8c04-a396b55d3525 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8dd2aec-4009-48ca-b9ba-1849435af1c5 req-51c92825-04a5-4bef-8c04-a396b55d3525 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8dd2aec-4009-48ca-b9ba-1849435af1c5 req-51c92825-04a5-4bef-8c04-a396b55d3525 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] No waiting events found dispatching network-vif-unplugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8dd2aec-4009-48ca-b9ba-1849435af1c5 req-51c92825-04a5-4bef-8c04-a396b55d3525 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received event network-vif-unplugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:09:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Instance destroyed successfully.
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.objects.instance [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lazy-loading 'resources' on Instance uuid e1bef3aa-b56f-47e3-8ab2-cf7736787326 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1078531263',display_name='tempest-DeleteServersTestJSON-server-1078531263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1078531263',id=19,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:07:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2487b11b988248af93e1d2d2b7c450bb',ramdisk_id='',reservation_id='r-3zvqvcte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-229895742',owner_user_name='tempest-DeleteServersTestJSON-229895742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:07:13Z,user_data=None,user_id='16838539a9744332abe3e3e99c19e9fb',uuid=e1bef3aa-b56f-47e3-8ab2-cf7736787326,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Converting VIF {"id": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "address": "fa:16:3e:1f:69:31", "network": {"id": "ae5a0424-0ef8-4c2c-bfcd-d334a637fe43", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1357988584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2487b11b988248af93e1d2d2b7c450bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f5d7be0-48", "ovs_interfaceid": "1f5d7be0-4876-4391-9e2a-33b7a653b49b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:69:31,bridge_name='br-int',has_traffic_filtering=True,id=1f5d7be0-4876-4391-9e2a-33b7a653b49b,network=Network(ae5a0424-0ef8-4c2c-bfcd-d334a637fe43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d7be0-48') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_vif [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:69:31,bridge_name='br-int',has_traffic_filtering=True,id=1f5d7be0-4876-4391-9e2a-33b7a653b49b,network=Network(ae5a0424-0ef8-4c2c-bfcd-d334a637fe43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d7be0-48') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f5d7be0-48, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f79f03a-176a-46c2-8647-be6a0764ce8c) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:04 user nova-compute[75305]: INFO os_vif [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:69:31,bridge_name='br-int',has_traffic_filtering=True,id=1f5d7be0-4876-4391-9e2a-33b7a653b49b,network=Network(ae5a0424-0ef8-4c2c-bfcd-d334a637fe43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f5d7be0-48')
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bwuALmHr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:09:04 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb4e55f-8f87-4706-a722-87f50472002d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:09:04 user nova-compute[75305]: No targets found.
Nov 14 08:09:04 user nova-compute[75305]: iSNS:
Nov 14 08:09:04 user nova-compute[75305]: No targets found.
Nov 14 08:09:04 user nova-compute[75305]: STATIC:
Nov 14 08:09:04 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:09:04 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:04 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:04 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b
Nov 14 08:09:04 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:04 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:04 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:09:04 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:04 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:04 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:09:04 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:04 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:04 user nova-compute[75305]: FIRMWARE:
Nov 14 08:09:04 user nova-compute[75305]: No targets found.
Nov 14 08:09:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:09:04 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:09:04 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ac8a22-99b6-4b92-8042-0c19e055ca0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc3oz7h7f/9be8d567573c4f149c867aec718e6bcf.delta /opt/stack/data/nova/instances/snapshots/tmpc3oz7h7f/9be8d567573c4f149c867aec718e6bcf {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3548a060-d31c-47c4-8da3-b6d0f450cc0e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:04 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:04 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:04 user nova-compute[75305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b (non-flash)
Nov 14 08:09:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:04 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:04 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:04 user nova-compute[75305]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b (non-flash)
Nov 14 08:09:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf447bf880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:09:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6453576-a772-4fed-a285-aa7340c66435]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb46099-2073-4c05-a73c-1308009f80f7]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1bb210-bb7a-4786-926c-0e2e1c8dcba8]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.082s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb11ae6a-bec2-48c5-b270-64292afe2159]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bcb158-13fe-4405-a424-0c9e9ae779e2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e498c3ab-3dd6-40d7-b946-65edef5e34e8]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260]
Nov 14 08:09:05 user nova-compute[75305]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b, portal: 172.16.0.220,3260] successful.
Nov 14 08:09:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4e1a6c3-bc2f-491d-8090-ca2246ab368b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e739ea5-7c07-4096-82f0-8a7c47da4825]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] <== disconnect_volume: return (447ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:09:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Deleting instance files /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326_del
Nov 14 08:09:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Deletion of /opt/stack/data/nova/instances/e1bef3aa-b56f-47e3-8ab2-cf7736787326_del complete
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc3oz7h7f/9be8d567573c4f149c867aec718e6bcf.delta /opt/stack/data/nova/instances/snapshots/tmpc3oz7h7f/9be8d567573c4f149c867aec718e6bcf" returned: 0 in 0.390s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Snapshot extracted, beginning image upload
Nov 14 08:09:05 user nova-compute[75305]: INFO nova.compute.manager [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Took 1.39 seconds to destroy the instance on the hypervisor.
Nov 14 08:09:05 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-de3d42eb-1517-4fee-8e9f-d08d40aa190e req-26f80979-acae-43f5-aaf1-def466320c60 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received event network-vif-deleted-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:05 user nova-compute[75305]: INFO nova.compute.manager [req-de3d42eb-1517-4fee-8e9f-d08d40aa190e req-26f80979-acae-43f5-aaf1-def466320c60 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Neutron deleted interface 1f5d7be0-4876-4391-9e2a-33b7a653b49b; detaching it from the instance and deleting it from the info cache
Nov 14 08:09:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-de3d42eb-1517-4fee-8e9f-d08d40aa190e req-26f80979-acae-43f5-aaf1-def466320c60 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-de3d42eb-1517-4fee-8e9f-d08d40aa190e req-26f80979-acae-43f5-aaf1-def466320c60 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Detach interface failed, port_id=1f5d7be0-4876-4391-9e2a-33b7a653b49b, reason: Instance e1bef3aa-b56f-47e3-8ab2-cf7736787326 could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:09:05 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Took 0.46 seconds to deallocate network for instance.
Nov 14 08:09:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e171e4b3-0867-4fb6-9c9a-edf2fe3df67e req-f75b94d3-cc48-437f-9722-071204472867 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received event network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e171e4b3-0867-4fb6-9c9a-edf2fe3df67e req-f75b94d3-cc48-437f-9722-071204472867 service nova] Acquiring lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e171e4b3-0867-4fb6-9c9a-edf2fe3df67e req-f75b94d3-cc48-437f-9722-071204472867 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e171e4b3-0867-4fb6-9c9a-edf2fe3df67e req-f75b94d3-cc48-437f-9722-071204472867 service nova] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e171e4b3-0867-4fb6-9c9a-edf2fe3df67e req-f75b94d3-cc48-437f-9722-071204472867 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] No waiting events found dispatching network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:06 user nova-compute[75305]: WARNING nova.compute.manager [req-e171e4b3-0867-4fb6-9c9a-edf2fe3df67e req-f75b94d3-cc48-437f-9722-071204472867 service nova] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Received unexpected event network-vif-plugged-1f5d7be0-4876-4391-9e2a-33b7a653b49b for instance with vm_state active and task_state deleting.
Nov 14 08:09:06 user nova-compute[75305]: INFO nova.compute.manager [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] [instance: e1bef3aa-b56f-47e3-8ab2-cf7736787326] Took 0.79 seconds to detach 1 volumes for instance.
Nov 14 08:09:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:06 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:07 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Deleted allocations for instance e1bef3aa-b56f-47e3-8ab2-cf7736787326
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-80334edc-5484-44af-b207-7f0e70cdf48d tempest-DeleteServersTestJSON-229895742 tempest-DeleteServersTestJSON-229895742-project-member] Lock "e1bef3aa-b56f-47e3-8ab2-cf7736787326" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.174s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEibpNgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:09:07 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:07 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:07 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbbacf1-142d-4552-a920-d11e3b44cf0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:09:07 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fed702a-5012-4e26-a788-31c5fd423666]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185] added
Nov 14 08:09:07 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0557110-e9bf-4841-bb96-17af11f857a0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[155f9f7d-b7f6-4bfa-976c-6fdb68e20036]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEibpNgr {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEibpNgr" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d079f559-8f85-4bb4-961b-10b596761bf5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TEibpNgr'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad659af-590f-4114-9dcf-ea7686c88852]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73425de-f633-414f-926b-bef6d3fd8113]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[016b9591-fb23-491f-8218-9b602de31b93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]
Nov 14 08:09:07 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.
Nov 14 08:09:07 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[affe407d-4826-48da-9e11-b1a5d3ea9b4b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df9580e-7c7e-438c-a18c-d7ca18cd2f42]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:07 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:09:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Snapshot image upload complete
Nov 14 08:09:07 user nova-compute[75305]: INFO nova.compute.manager [None req-97211006-5cf7-47a3-b62a-5d427fa73054 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Took 5.35 seconds to snapshot the instance on the hypervisor.
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[72929c7c-9882-4a29-b41e-ab9b3eb4c9e6]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:09:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEibpNgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:09:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23265376132346364', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:09:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265376132346364', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:09:08 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'flavor' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:09:08 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:09:08 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:09:08 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:09:08 user nova-compute[75305]:   <serial>57d5a02e-0d68-452c-8d13-6ffeb3976185</serial>
Nov 14 08:09:08 user nova-compute[75305]: </disk>
Nov 14 08:09:08 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:09:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:09:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:09:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No VIF found with MAC fa:16:3e:8f:2f:04, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:09:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f84f91a8-8806-4d17-8076-2d7072fb4c5a tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.720s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing instance network info cache due to event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:09:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:09:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:09:13 user nova-compute[75305]: DEBUG nova.network.neutron [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:09:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updated VIF entry in instance network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:09:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a6475083-7a1e-4dd3-8a16-2a0e50572613 req-68ac7bd2-d60d-4a4d-8c4f-3575de6b6d14 service nova] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:09:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing instance network info cache due to event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:09:15 user nova-compute[75305]: DEBUG nova.network.neutron [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG nova.network.neutron [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updated VIF entry in instance network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG nova.network.neutron [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e8ab2ff0-4c83-4ebb-b15c-01599639b45f req-5c499149-0817-4e27-9ce5-90e1b1c6ba69 service nova] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 is timed out.
Nov 14 08:09:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Successfully detached device vdb from instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 from the live domain config.
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cztqaQRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '4d05c111-8167-402a-955a-3f75ed70f428'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:09:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d51f4c1-cfea-48bc-bf0e-018fe544427c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:09:16 user nova-compute[75305]: No targets found.
Nov 14 08:09:16 user nova-compute[75305]: iSNS:
Nov 14 08:09:16 user nova-compute[75305]: No targets found.
Nov 14 08:09:16 user nova-compute[75305]: STATIC:
Nov 14 08:09:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185
Nov 14 08:09:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:09:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428
Nov 14 08:09:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:09:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:16 user nova-compute[75305]: FIRMWARE:
Nov 14 08:09:16 user nova-compute[75305]: No targets found.
Nov 14 08:09:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:09:16 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:09:16 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80ee72-6f09-4d02-96a4-62adffedc4bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b79d34-4cb4-4091-b4e6-b0849a95a159]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442ab490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428'): ({'sdf'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Removing single pathed devices sdf {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa54c16-f1c5-43a5-8746-ce5675bfa7ac]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[318a1e4a-2407-470a-8c97-a2c0331a6d22]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Flushing IO for device /dev/sdf {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[541492ba-afcf-4af3-9e2d-c9181b1f28ab]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f3c6ee-e84b-4c0a-a143-786cbad03044]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.066s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf2ee4-6ccb-43d5-9979-2dcd0ee62ea0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6875f-28df-4e77-835f-fbcc24b6fab6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260]
Nov 14 08:09:17 user nova-compute[75305]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428, portal: 172.16.0.220,3260] successful.
Nov 14 08:09:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d05c111-8167-402a-955a-3f75ed70f428 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6002d632-87e8-4109-8283-dcd636ceef59]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] <== disconnect_volume: return (422ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:17 user nova-compute[75305]: INFO nova.compute.manager [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Rebooting instance
Nov 14 08:09:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG nova.objects.instance [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lazy-loading 'flavor' on Instance uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0cde0c88-017c-43a0-aabd-ff25d04efc90 tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.964s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e30fb6e-fef3-4b66-9ca6-93de953fddff req-b3e6d2c5-7f2c-458f-b1e1-2702324036a8 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e30fb6e-fef3-4b66-9ca6-93de953fddff req-b3e6d2c5-7f2c-458f-b1e1-2702324036a8 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e30fb6e-fef3-4b66-9ca6-93de953fddff req-b3e6d2c5-7f2c-458f-b1e1-2702324036a8 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3e30fb6e-fef3-4b66-9ca6-93de953fddff req-b3e6d2c5-7f2c-458f-b1e1-2702324036a8 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-3e30fb6e-fef3-4b66-9ca6-93de953fddff req-b3e6d2c5-7f2c-458f-b1e1-2702324036a8 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:19 user nova-compute[75305]: WARNING nova.compute.manager [req-3e30fb6e-fef3-4b66-9ca6-93de953fddff req-b3e6d2c5-7f2c-458f-b1e1-2702324036a8 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance destroyed successfully.
Nov 14 08:09:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'resources' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1030370936',display_name='tempest-TestMinimumBasicScenario-server-1030370936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1030370936',id=20,image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2RLG9owF1Nc7k0X8tP8zsStohtcewc48Y+CrHnjSnuOkdnHc1S2LIwE7uLd+b7l9fC53B0GI/xmUskFmZD845kIKEB4cJ2YaftNCILebKGzEjZ0424jmXX8dzmF2pI7g==',key_name='tempest-TestMinimumBasicScenario-484244990',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-oj8ex2zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:09:19Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=10780135-d628-4567-9825-91df6d78dd22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_vif [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9275f27d-45, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fe59236-1655-4a2b-b740-e952d0b0c078) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:19 user nova-compute[75305]: INFO os_vif [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45')
Nov 14 08:09:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEibpNgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:09:19 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8599d5c-b818-4494-9758-91ccdd9b8f5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:09:19 user nova-compute[75305]: No targets found.
Nov 14 08:09:19 user nova-compute[75305]: iSNS:
Nov 14 08:09:19 user nova-compute[75305]: No targets found.
Nov 14 08:09:19 user nova-compute[75305]: STATIC:
Nov 14 08:09:19 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185
Nov 14 08:09:19 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:19 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:19 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:09:19 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:19 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:19 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:09:19 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:09:19 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:09:19 user nova-compute[75305]: FIRMWARE:
Nov 14 08:09:19 user nova-compute[75305]: No targets found.
Nov 14 08:09:19 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:09:19 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:09:19 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f66f7a5-0b56-496d-99f2-329cb4931267]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab655a3-c954-4707-9e37-a0473e04b615]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:19 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:19 user nova-compute[75305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:19 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:19 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:19 user nova-compute[75305]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:19 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442c41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f709a982-f09c-4b70-9927-9ac0fe5d7ed7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed48931e-048d-4a32-9cee-e6ad1bb849a2]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbb1918-543d-401e-bcde-f90664a7aad6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43d22d6-f2f3-47cb-b39d-af2d99b2beb2]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:09:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[198a89aa-0198-4c9d-826a-733b3ba6ef4b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:09:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7347MB free_disk=25.07111358642578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc546ec-9159-4d37-8f3c-8ffa07bd2ee0]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]
Nov 14 08:09:20 user nova-compute[75305]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.
Nov 14 08:09:20 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83240be1-c52c-4e8e-96d8-b2f6833508ec]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.680s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== disconnect_volume: return (681ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Start _get_guest_xml network_info=[{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b765263c-c7b9-4d71-ad2e-0a1cab07f385,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'b765263c-c7b9-4d71-ad2e-0a1cab07f385'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '0713c30f-c18b-4c00-af84-1df142afab32', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEibpNgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '10780135-d628-4567-9825-91df6d78dd22', 'attached_at': '', 'detached_at': '', 'volume_id': '57d5a02e-0d68-452c-8d13-6ffeb3976185', 'serial': '57d5a02e-0d68-452c-8d13-6ffeb3976185'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:09:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:09:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b765263c-c7b9-4d71-ad2e-0a1cab07f385,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5959dc8-a417-4528-9f03-3951186c2315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance e70bba44-e95d-4685-b5ae-18ea4ff42d21 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 10780135-d628-4567-9825-91df6d78dd22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance b495d719-82f6-48e8-9536-656d2f5513d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.objects.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Object Instance<10780135-d628-4567-9825-91df6d78dd22> lazy-loaded attributes: resources,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEibpNgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:09:20 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:20 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:09:20 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da387c8-e504-47ed-b78b-942d317b4661]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:09:20 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fcec52-58a6-4f88-9693-a92dd6e70c5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185] added
Nov 14 08:09:20 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b862701b-880d-4270-a4f6-b97ae1f3d84c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94d3d6d-d1eb-4c5c-a625-eaf1f504b40a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEibpNgr {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TEibpNgr" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[982be614-3ec2-4e85-bb62-bb77a82f7212]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TEibpNgr'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[547c3da2-2776-45ea-955a-0b986c30ee40]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.057s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2033018c-758a-41ac-8f5b-e9e8efa13849]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1df7beb-bcdf-4e60-abd9-b01b5e886dca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]
Nov 14 08:09:20 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.
Nov 14 08:09:20 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b04698-cf90-46fb-8119-8e701d4cbc8c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81728a0-8234-4cd4-b440-bd823f34c380]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:09:20 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91589c7-329e-4fe6-85fa-63e0b73f722a]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:09:20 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEibpNgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-2f75bbef-a5ce-4291-9fa6-fbb04a480654 req-7e675d6c-7b43-476d-a142-390ae3841899 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2f75bbef-a5ce-4291-9fa6-fbb04a480654 req-7e675d6c-7b43-476d-a142-390ae3841899 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2f75bbef-a5ce-4291-9fa6-fbb04a480654 req-7e675d6c-7b43-476d-a142-390ae3841899 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2f75bbef-a5ce-4291-9fa6-fbb04a480654 req-7e675d6c-7b43-476d-a142-390ae3841899 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-2f75bbef-a5ce-4291-9fa6-fbb04a480654 req-7e675d6c-7b43-476d-a142-390ae3841899 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:21 user nova-compute[75305]: WARNING nova.compute.manager [req-2f75bbef-a5ce-4291-9fa6-fbb04a480654 req-7e675d6c-7b43-476d-a142-390ae3841899 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 08:09:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '23265376132346364', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265376132346364', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1030370936',display_name='tempest-TestMinimumBasicScenario-server-1030370936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1030370936',id=20,image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2RLG9owF1Nc7k0X8tP8zsStohtcewc48Y+CrHnjSnuOkdnHc1S2LIwE7uLd+b7l9fC53B0GI/xmUskFmZD845kIKEB4cJ2YaftNCILebKGzEjZ0424jmXX8dzmF2pI7g==',key_name='tempest-TestMinimumBasicScenario-484244990',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-oj8ex2zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:09:19Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=10780135-d628-4567-9825-91df6d78dd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'pci_devices' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.objects.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Object Instance<10780135-d628-4567-9825-91df6d78dd22> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:09:21 user nova-compute[75305]:   <uuid>10780135-d628-4567-9825-91df6d78dd22</uuid>
Nov 14 08:09:21 user nova-compute[75305]:   <name>instance-00000014</name>
Nov 14 08:09:21 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:09:21 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:09:21 user nova-compute[75305]:   <metadata>
Nov 14 08:09:21 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:09:21 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:09:21 user nova-compute[75305]:       <nova:name>tempest-TestMinimumBasicScenario-server-1030370936</nova:name>
Nov 14 08:09:21 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:09:20</nova:creationTime>
Nov 14 08:09:21 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:09:21 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:09:21 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:09:21 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:09:21 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:09:21 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:09:21 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:09:21 user nova-compute[75305]:       <nova:owner>
Nov 14 08:09:21 user nova-compute[75305]:         <nova:user uuid="f7906829f99049d2bb0a97c80917cb3a">tempest-TestMinimumBasicScenario-1127831644-project-member</nova:user>
Nov 14 08:09:21 user nova-compute[75305]:         <nova:project uuid="21b880ff94ef40409fe2b772dee93662">tempest-TestMinimumBasicScenario-1127831644</nova:project>
Nov 14 08:09:21 user nova-compute[75305]:       </nova:owner>
Nov 14 08:09:21 user nova-compute[75305]:       <nova:root type="image" uuid="b765263c-c7b9-4d71-ad2e-0a1cab07f385"/>
Nov 14 08:09:21 user nova-compute[75305]:       <nova:ports>
Nov 14 08:09:21 user nova-compute[75305]:         <nova:port uuid="9275f27d-45d9-4ee4-8756-8f0685060d91">
Nov 14 08:09:21 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:09:21 user nova-compute[75305]:         </nova:port>
Nov 14 08:09:21 user nova-compute[75305]:       </nova:ports>
Nov 14 08:09:21 user nova-compute[75305]:     </nova:instance>
Nov 14 08:09:21 user nova-compute[75305]:   </metadata>
Nov 14 08:09:21 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:09:21 user nova-compute[75305]:     <system>
Nov 14 08:09:21 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:09:21 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:09:21 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:09:21 user nova-compute[75305]:       <entry name="serial">10780135-d628-4567-9825-91df6d78dd22</entry>
Nov 14 08:09:21 user nova-compute[75305]:       <entry name="uuid">10780135-d628-4567-9825-91df6d78dd22</entry>
Nov 14 08:09:21 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:09:21 user nova-compute[75305]:     </system>
Nov 14 08:09:21 user nova-compute[75305]:   </sysinfo>
Nov 14 08:09:21 user nova-compute[75305]:   <os>
Nov 14 08:09:21 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:09:21 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:09:21 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:09:21 user nova-compute[75305]:   </os>
Nov 14 08:09:21 user nova-compute[75305]:   <features>
Nov 14 08:09:21 user nova-compute[75305]:     <acpi/>
Nov 14 08:09:21 user nova-compute[75305]:     <apic/>
Nov 14 08:09:21 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:09:21 user nova-compute[75305]:   </features>
Nov 14 08:09:21 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:09:21 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:09:21 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:09:21 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:09:21 user nova-compute[75305]:   </clock>
Nov 14 08:09:21 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:09:21 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:09:21 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:09:21 user nova-compute[75305]:   </cpu>
Nov 14 08:09:21 user nova-compute[75305]:   <devices>
Nov 14 08:09:21 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:09:21 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:09:21 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk"/>
Nov 14 08:09:21 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:09:21 user nova-compute[75305]:     </disk>
Nov 14 08:09:21 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:09:21 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:09:21 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:09:21 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:09:21 user nova-compute[75305]:       <serial>57d5a02e-0d68-452c-8d13-6ffeb3976185</serial>
Nov 14 08:09:21 user nova-compute[75305]:     </disk>
Nov 14 08:09:21 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:09:21 user nova-compute[75305]:       <mac address="fa:16:3e:8f:2f:04"/>
Nov 14 08:09:21 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:09:21 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:09:21 user nova-compute[75305]:       <target dev="tap9275f27d-45"/>
Nov 14 08:09:21 user nova-compute[75305]:     </interface>
Nov 14 08:09:21 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:09:21 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/console.log" append="off"/>
Nov 14 08:09:21 user nova-compute[75305]:     </serial>
Nov 14 08:09:21 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:09:21 user nova-compute[75305]:     <video>
Nov 14 08:09:21 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:09:21 user nova-compute[75305]:     </video>
Nov 14 08:09:21 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:09:21 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:09:21 user nova-compute[75305]:     </rng>
Nov 14 08:09:21 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:09:21 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:09:21 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:09:21 user nova-compute[75305]:     </memballoon>
Nov 14 08:09:21 user nova-compute[75305]:   </devices>
Nov 14 08:09:21 user nova-compute[75305]: </domain>
Nov 14 08:09:21 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:09:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'trusted_certs' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.objects.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Object Instance<10780135-d628-4567-9825-91df6d78dd22> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Cannot resize image /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'migration_context' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.objects.base [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Object Instance<10780135-d628-4567-9825-91df6d78dd22> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1030370936',display_name='tempest-TestMinimumBasicScenario-server-1030370936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1030370936',id=20,image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2RLG9owF1Nc7k0X8tP8zsStohtcewc48Y+CrHnjSnuOkdnHc1S2LIwE7uLd+b7l9fC53B0GI/xmUskFmZD845kIKEB4cJ2YaftNCILebKGzEjZ0424jmXX8dzmF2pI7g==',key_name='tempest-TestMinimumBasicScenario-484244990',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-oj8ex2zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:09:19Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=10780135-d628-4567-9825-91df6d78dd22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG os_vif [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bb23ebb-657a-5385-9b03-5215aed8baa7', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9275f27d-45, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9275f27d-45, col_values=(('qos', UUID('f47ca980-a8a6-41ce-ab14-0150a6adaec5')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9275f27d-45, col_values=(('external_ids', {'iface-id': '9275f27d-45d9-4ee4-8756-8f0685060d91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:2f:04', 'vm-uuid': '10780135-d628-4567-9825-91df6d78dd22'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:22 user nova-compute[75305]: INFO os_vif [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45')
Nov 14 08:09:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:09:23 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-48686492-1fc0-4a01-a7d7-442d20c9d3b0 req-d200857e-b762-4109-a067-44acb50e1a37 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48686492-1fc0-4a01-a7d7-442d20c9d3b0 req-d200857e-b762-4109-a067-44acb50e1a37 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48686492-1fc0-4a01-a7d7-442d20c9d3b0 req-d200857e-b762-4109-a067-44acb50e1a37 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48686492-1fc0-4a01-a7d7-442d20c9d3b0 req-d200857e-b762-4109-a067-44acb50e1a37 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-48686492-1fc0-4a01-a7d7-442d20c9d3b0 req-d200857e-b762-4109-a067-44acb50e1a37 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:24 user nova-compute[75305]: WARNING nova.compute.manager [req-48686492-1fc0-4a01-a7d7-442d20c9d3b0 req-d200857e-b762-4109-a067-44acb50e1a37 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 08:09:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:09:26 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance rebooted successfully.
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7c1cae0a-81e4-41bb-a96c-71fd10c07a41 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.424s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-186fcbfb-2d91-437d-bde7-17b89f572003 req-ac8c4af1-bdaf-4926-a8b0-8acc1e4feef6 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-186fcbfb-2d91-437d-bde7-17b89f572003 req-ac8c4af1-bdaf-4926-a8b0-8acc1e4feef6 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-186fcbfb-2d91-437d-bde7-17b89f572003 req-ac8c4af1-bdaf-4926-a8b0-8acc1e4feef6 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-186fcbfb-2d91-437d-bde7-17b89f572003 req-ac8c4af1-bdaf-4926-a8b0-8acc1e4feef6 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-186fcbfb-2d91-437d-bde7-17b89f572003 req-ac8c4af1-bdaf-4926-a8b0-8acc1e4feef6 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:26 user nova-compute[75305]: WARNING nova.compute.manager [req-186fcbfb-2d91-437d-bde7-17b89f572003 req-ac8c4af1-bdaf-4926-a8b0-8acc1e4feef6 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state active and task_state None.
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:26 user nova-compute[75305]: INFO nova.compute.manager [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Terminating instance
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-094a6eec-39c5-4915-9bba-11a3daebf081 req-ec85f4ef-100e-49ba-a586-f7ce90a2a694 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-094a6eec-39c5-4915-9bba-11a3daebf081 req-ec85f4ef-100e-49ba-a586-f7ce90a2a694 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-094a6eec-39c5-4915-9bba-11a3daebf081 req-ec85f4ef-100e-49ba-a586-f7ce90a2a694 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-094a6eec-39c5-4915-9bba-11a3daebf081 req-ec85f4ef-100e-49ba-a586-f7ce90a2a694 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-094a6eec-39c5-4915-9bba-11a3daebf081 req-ec85f4ef-100e-49ba-a586-f7ce90a2a694 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-094a6eec-39c5-4915-9bba-11a3daebf081 req-ec85f4ef-100e-49ba-a586-f7ce90a2a694 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-unplugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:09:27 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Instance destroyed successfully.
Nov 14 08:09:27 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lazy-loading 'resources' on Instance uuid f5959dc8-a417-4528-9f03-3951186c2315 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-943852596',display_name='tempest-ServerStableDeviceRescueTest-server-943852596',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-943852596',id=3,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5yoSnB7TPx2ScUHUeCSeilBC6NPHdqO/tlTcNF4+qm6O99Zzd7+sVaj7DbuusQ21GcjrgPt0ZWBVmhYkzdVe4Qy9hFQIiVYujxr2o4UKvSp4MMiIV/5ORL5AoTD5Zjng==',key_name='tempest-keypair-1894394159',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fa8ff9cd1d54897a96c555021604b00',ramdisk_id='',reservation_id='r-0f8a7vk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1375221339',owner_user_name='tempest-ServerStableDeviceRescueTest-1375221339-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:08:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18e38ea4aaf84e82afd404b88ae4d6cc',uuid=f5959dc8-a417-4528-9f03-3951186c2315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converting VIF {"id": "11d90697-5697-4fd9-8284-99e99196df6e", "address": "fa:16:3e:97:d5:dc", "network": {"id": "3dc5b02d-5dd9-485f-a65e-03ac491fee87", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-808784431-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fa8ff9cd1d54897a96c555021604b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11d90697-56", "ovs_interfaceid": "11d90697-5697-4fd9-8284-99e99196df6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG os_vif [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11d90697-56, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a22f58f3-055e-4064-a1a0-e7492a19ce59) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:27 user nova-compute[75305]: INFO os_vif [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:d5:dc,bridge_name='br-int',has_traffic_filtering=True,id=11d90697-5697-4fd9-8284-99e99196df6e,network=Network(3dc5b02d-5dd9-485f-a65e-03ac491fee87),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11d90697-56')
Nov 14 08:09:27 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Deleting instance files /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315_del
Nov 14 08:09:27 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Deletion of /opt/stack/data/nova/instances/f5959dc8-a417-4528-9f03-3951186c2315_del complete
Nov 14 08:09:27 user nova-compute[75305]: INFO nova.compute.manager [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 08:09:27 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:09:27 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:09:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:28 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:28 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Took 0.76 seconds to deallocate network for instance.
Nov 14 08:09:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-f3945fe5-c330-4956-bede-39dc9f82c39f req-f0e4d3a9-b3f7-43d1-8d83-edf340897798 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-deleted-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:28 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:09:28 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:09:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:28 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Deleted allocations for instance f5959dc8-a417-4528-9f03-3951186c2315
Nov 14 08:09:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9947641c-c8ac-4f10-acdf-e9f49d52d6d2 tempest-ServerStableDeviceRescueTest-1375221339 tempest-ServerStableDeviceRescueTest-1375221339-project-member] Lock "f5959dc8-a417-4528-9f03-3951186c2315" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.198s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-37f1e7de-73cf-41c2-93c2-7ad98d39d0d0 req-adac798e-5e35-4e71-bddd-7ff063ff2fb8 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37f1e7de-73cf-41c2-93c2-7ad98d39d0d0 req-adac798e-5e35-4e71-bddd-7ff063ff2fb8 service nova] Acquiring lock "f5959dc8-a417-4528-9f03-3951186c2315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37f1e7de-73cf-41c2-93c2-7ad98d39d0d0 req-adac798e-5e35-4e71-bddd-7ff063ff2fb8 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37f1e7de-73cf-41c2-93c2-7ad98d39d0d0 req-adac798e-5e35-4e71-bddd-7ff063ff2fb8 service nova] Lock "f5959dc8-a417-4528-9f03-3951186c2315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-37f1e7de-73cf-41c2-93c2-7ad98d39d0d0 req-adac798e-5e35-4e71-bddd-7ff063ff2fb8 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] No waiting events found dispatching network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:29 user nova-compute[75305]: WARNING nova.compute.manager [req-37f1e7de-73cf-41c2-93c2-7ad98d39d0d0 req-adac798e-5e35-4e71-bddd-7ff063ff2fb8 service nova] [instance: f5959dc8-a417-4528-9f03-3951186c2315] Received unexpected event network-vif-plugged-11d90697-5697-4fd9-8284-99e99196df6e for instance with vm_state deleted and task_state None.
Nov 14 08:09:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:09:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:09:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:09:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:46 user nova-compute[75305]: INFO nova.compute.manager [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Terminating instance
Nov 14 08:09:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-17e0b1ec-a968-497f-b7a0-261fb7af3473 req-0229a092-b48a-4fc7-8e33-e211386ac113 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-unplugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17e0b1ec-a968-497f-b7a0-261fb7af3473 req-0229a092-b48a-4fc7-8e33-e211386ac113 service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17e0b1ec-a968-497f-b7a0-261fb7af3473 req-0229a092-b48a-4fc7-8e33-e211386ac113 service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17e0b1ec-a968-497f-b7a0-261fb7af3473 req-0229a092-b48a-4fc7-8e33-e211386ac113 service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-17e0b1ec-a968-497f-b7a0-261fb7af3473 req-0229a092-b48a-4fc7-8e33-e211386ac113 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-unplugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-17e0b1ec-a968-497f-b7a0-261fb7af3473 req-0229a092-b48a-4fc7-8e33-e211386ac113 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-unplugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Instance destroyed successfully.
Nov 14 08:09:47 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lazy-loading 'resources' on Instance uuid e70bba44-e95d-4685-b5ae-18ea4ff42d21 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:06:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-781466061',display_name='tempest-TestVolumeSwap-server-781466061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-781466061',id=17,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVWkKH/9GiYB992LOd9NryAwt81fBbe4PvtCeg159g62rbWmxcBE2PeJSUMDOZ/kFGfbTnKMt6uHsQhJOALCnRSg1NhJsUq40OfHlwRzKkNXWI7pjkrmldR4k64Hp9ESw==',key_name='tempest-keypair-814636690',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08d64a4402634675b6565ef1dd2e11d2',ramdisk_id='',reservation_id='r-4r80knhm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1450931470',owner_user_name='tempest-TestVolumeSwap-1450931470-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:06:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01aef878d55548b38330a5dee6631c37',uuid=e70bba44-e95d-4685-b5ae-18ea4ff42d21,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Converting VIF {"id": "9b473587-96aa-487c-b433-ec95b036b9aa", "address": "fa:16:3e:5e:73:1c", "network": {"id": "09be2324-8fa3-492a-8bc8-217f49c74a43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1131676715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08d64a4402634675b6565ef1dd2e11d2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b473587-96", "ovs_interfaceid": "9b473587-96aa-487c-b433-ec95b036b9aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:73:1c,bridge_name='br-int',has_traffic_filtering=True,id=9b473587-96aa-487c-b433-ec95b036b9aa,network=Network(09be2324-8fa3-492a-8bc8-217f49c74a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b473587-96') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG os_vif [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:73:1c,bridge_name='br-int',has_traffic_filtering=True,id=9b473587-96aa-487c-b433-ec95b036b9aa,network=Network(09be2324-8fa3-492a-8bc8-217f49c74a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b473587-96') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b473587-96, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=693b8100-424d-4021-9444-7021679c8ba8) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:09:47 user nova-compute[75305]: INFO os_vif [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:73:1c,bridge_name='br-int',has_traffic_filtering=True,id=9b473587-96aa-487c-b433-ec95b036b9aa,network=Network(09be2324-8fa3-492a-8bc8-217f49c74a43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b473587-96')
Nov 14 08:09:47 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Deleting instance files /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21_del
Nov 14 08:09:47 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Deletion of /opt/stack/data/nova/instances/e70bba44-e95d-4685-b5ae-18ea4ff42d21_del complete
Nov 14 08:09:47 user nova-compute[75305]: INFO nova.compute.manager [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 08:09:47 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:09:48 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Took 0.97 seconds to deallocate network for instance.
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-9d2cd346-54e0-4dc9-b1e3-75cbed7c3c95 req-f195fff7-9790-458c-abb3-b26eb90b8599 service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-deleted-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:48 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Deleted allocations for instance e70bba44-e95d-4685-b5ae-18ea4ff42d21
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4073bd90-a4c2-44bc-99f7-b0192a14dfba tempest-TestVolumeSwap-1450931470 tempest-TestVolumeSwap-1450931470-project-member] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:48 user nova-compute[75305]: WARNING nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received unexpected event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with vm_state deleted and task_state None.
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:48 user nova-compute[75305]: WARNING nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received unexpected event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with vm_state deleted and task_state None.
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:48 user nova-compute[75305]: WARNING nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received unexpected event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with vm_state deleted and task_state None.
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-unplugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-unplugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:48 user nova-compute[75305]: WARNING nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received unexpected event network-vif-unplugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with vm_state deleted and task_state None.
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Acquiring lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] Lock "e70bba44-e95d-4685-b5ae-18ea4ff42d21-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:09:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] No waiting events found dispatching network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:09:48 user nova-compute[75305]: WARNING nova.compute.manager [req-827f4e24-8865-4be4-a95e-228f03301cea req-7369e576-f947-4e95-93d7-ec97d29db87e service nova] [instance: e70bba44-e95d-4685-b5ae-18ea4ff42d21] Received unexpected event network-vif-plugged-9b473587-96aa-487c-b433-ec95b036b9aa for instance with vm_state deleted and task_state None.
Nov 14 08:09:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:09:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:10:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:10:04 user nova-compute[75305]: INFO nova.compute.claims [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Claim successful on node user
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.346s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:10:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.policy [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '204f40785a034dcb8311e8350c5b4ba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5b5ab92b56141ddae4e993ad5f5367f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:10:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Creating image(s)
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "/opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "/opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "/opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk 1073741824" returned: 0 in 0.061s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Successfully created port: 6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Cannot resize image /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Ensure instance console log exists: /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Successfully updated port: 6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquired lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-changed-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Refreshing instance network info cache due to event network-changed-6ffb3807-5d0f-4854-8636-f11f27f02f08. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] Acquiring lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.neutron [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updating instance_info_cache with network_info: [{"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Releasing lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Instance network_info: |[{"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] Acquired lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.neutron [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Refreshing network info cache for port 6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Start _get_guest_xml network_info=[{"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:10:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-882073150',display_name='tempest-TestServerVolumeAttachmentScenario-server-882073150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-882073150',id=23,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCGkr3r5Oc4dgd28ueHBjgE9Jsy38IzL+ajpXk2XpO5gjnqz+i8z+N/c8fnoF/uDbSpS8bo3w3M7fJEzq6q/9BOB95i1FCInOpOoSMiEnPI1s1z4yqSX00NUeVrR5KQhg==',key_name='tempest-keypair-685130155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5b5ab92b56141ddae4e993ad5f5367f',ramdisk_id='',reservation_id='r-0sk2xyrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1663990830',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1663990830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204f40785a034dcb8311e8350c5b4ba6',uuid=dafc732a-81ec-412e-b237-1b18bd6cb577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Converting VIF {"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:9c:4a,bridge_name='br-int',has_traffic_filtering=True,id=6ffb3807-5d0f-4854-8636-f11f27f02f08,network=Network(a878b624-ca2b-451b-8c24-18a429c02cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ffb3807-5d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.objects.instance [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'pci_devices' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:10:06 user nova-compute[75305]:   <uuid>dafc732a-81ec-412e-b237-1b18bd6cb577</uuid>
Nov 14 08:10:06 user nova-compute[75305]:   <name>instance-00000017</name>
Nov 14 08:10:06 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:10:06 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:10:06 user nova-compute[75305]:   <metadata>
Nov 14 08:10:06 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:10:06 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:10:06 user nova-compute[75305]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-882073150</nova:name>
Nov 14 08:10:06 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:10:06</nova:creationTime>
Nov 14 08:10:06 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:10:06 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:10:06 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:10:06 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:10:06 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:10:06 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:10:06 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:10:06 user nova-compute[75305]:       <nova:owner>
Nov 14 08:10:06 user nova-compute[75305]:         <nova:user uuid="204f40785a034dcb8311e8350c5b4ba6">tempest-TestServerVolumeAttachmentScenario-1663990830-project-member</nova:user>
Nov 14 08:10:06 user nova-compute[75305]:         <nova:project uuid="b5b5ab92b56141ddae4e993ad5f5367f">tempest-TestServerVolumeAttachmentScenario-1663990830</nova:project>
Nov 14 08:10:06 user nova-compute[75305]:       </nova:owner>
Nov 14 08:10:06 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:10:06 user nova-compute[75305]:       <nova:ports>
Nov 14 08:10:06 user nova-compute[75305]:         <nova:port uuid="6ffb3807-5d0f-4854-8636-f11f27f02f08">
Nov 14 08:10:06 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:10:06 user nova-compute[75305]:         </nova:port>
Nov 14 08:10:06 user nova-compute[75305]:       </nova:ports>
Nov 14 08:10:06 user nova-compute[75305]:     </nova:instance>
Nov 14 08:10:06 user nova-compute[75305]:   </metadata>
Nov 14 08:10:06 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:10:06 user nova-compute[75305]:     <system>
Nov 14 08:10:06 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:10:06 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:10:06 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:10:06 user nova-compute[75305]:       <entry name="serial">dafc732a-81ec-412e-b237-1b18bd6cb577</entry>
Nov 14 08:10:06 user nova-compute[75305]:       <entry name="uuid">dafc732a-81ec-412e-b237-1b18bd6cb577</entry>
Nov 14 08:10:06 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:10:06 user nova-compute[75305]:     </system>
Nov 14 08:10:06 user nova-compute[75305]:   </sysinfo>
Nov 14 08:10:06 user nova-compute[75305]:   <os>
Nov 14 08:10:06 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:10:06 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:10:06 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:10:06 user nova-compute[75305]:   </os>
Nov 14 08:10:06 user nova-compute[75305]:   <features>
Nov 14 08:10:06 user nova-compute[75305]:     <acpi/>
Nov 14 08:10:06 user nova-compute[75305]:     <apic/>
Nov 14 08:10:06 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:10:06 user nova-compute[75305]:   </features>
Nov 14 08:10:06 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:10:06 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:10:06 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:10:06 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:10:06 user nova-compute[75305]:   </clock>
Nov 14 08:10:06 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:10:06 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:10:06 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:10:06 user nova-compute[75305]:   </cpu>
Nov 14 08:10:06 user nova-compute[75305]:   <devices>
Nov 14 08:10:06 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:10:06 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:10:06 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk"/>
Nov 14 08:10:06 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:10:06 user nova-compute[75305]:     </disk>
Nov 14 08:10:06 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:10:06 user nova-compute[75305]:       <mac address="fa:16:3e:13:9c:4a"/>
Nov 14 08:10:06 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:06 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:10:06 user nova-compute[75305]:       <target dev="tap6ffb3807-5d"/>
Nov 14 08:10:06 user nova-compute[75305]:     </interface>
Nov 14 08:10:06 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:10:06 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/console.log" append="off"/>
Nov 14 08:10:06 user nova-compute[75305]:     </serial>
Nov 14 08:10:06 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:10:06 user nova-compute[75305]:     <video>
Nov 14 08:10:06 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:06 user nova-compute[75305]:     </video>
Nov 14 08:10:06 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:10:06 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:10:06 user nova-compute[75305]:     </rng>
Nov 14 08:10:06 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:10:06 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:10:06 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:10:06 user nova-compute[75305]:     </memballoon>
Nov 14 08:10:06 user nova-compute[75305]:   </devices>
Nov 14 08:10:06 user nova-compute[75305]: </domain>
Nov 14 08:10:06 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-882073150',display_name='tempest-TestServerVolumeAttachmentScenario-server-882073150',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-882073150',id=23,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCGkr3r5Oc4dgd28ueHBjgE9Jsy38IzL+ajpXk2XpO5gjnqz+i8z+N/c8fnoF/uDbSpS8bo3w3M7fJEzq6q/9BOB95i1FCInOpOoSMiEnPI1s1z4yqSX00NUeVrR5KQhg==',key_name='tempest-keypair-685130155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5b5ab92b56141ddae4e993ad5f5367f',ramdisk_id='',reservation_id='r-0sk2xyrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1663990830',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1663990830-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204f40785a034dcb8311e8350c5b4ba6',uuid=dafc732a-81ec-412e-b237-1b18bd6cb577,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Converting VIF {"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:9c:4a,bridge_name='br-int',has_traffic_filtering=True,id=6ffb3807-5d0f-4854-8636-f11f27f02f08,network=Network(a878b624-ca2b-451b-8c24-18a429c02cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ffb3807-5d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG os_vif [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:9c:4a,bridge_name='br-int',has_traffic_filtering=True,id=6ffb3807-5d0f-4854-8636-f11f27f02f08,network=Network(a878b624-ca2b-451b-8c24-18a429c02cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ffb3807-5d') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cec9a5a9-b226-5625-a5ae-87e435194799', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ffb3807-5d, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ffb3807-5d, col_values=(('qos', UUID('0a05c112-6907-4042-ab22-7919eca85f0f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ffb3807-5d, col_values=(('external_ids', {'iface-id': '6ffb3807-5d0f-4854-8636-f11f27f02f08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:9c:4a', 'vm-uuid': 'dafc732a-81ec-412e-b237-1b18bd6cb577'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:06 user nova-compute[75305]: INFO os_vif [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:9c:4a,bridge_name='br-int',has_traffic_filtering=True,id=6ffb3807-5d0f-4854-8636-f11f27f02f08,network=Network(a878b624-ca2b-451b-8c24-18a429c02cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ffb3807-5d')
Nov 14 08:10:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:10:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No VIF found with MAC fa:16:3e:13:9c:4a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:10:07 user nova-compute[75305]: DEBUG nova.network.neutron [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updated VIF entry in instance network info cache for port 6ffb3807-5d0f-4854-8636-f11f27f02f08. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:10:07 user nova-compute[75305]: DEBUG nova.network.neutron [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updating instance_info_cache with network_info: [{"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7bea5598-ce70-4563-9862-e4fd05005789 req-5c7e31d3-01b9-4b25-ac3e-f35932a5895d service nova] Releasing lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0e45d804-f1d4-48cb-85a8-637dcd8509ef req-2f9c8a02-cc3b-499b-9650-3946c3f6b1e9 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0e45d804-f1d4-48cb-85a8-637dcd8509ef req-2f9c8a02-cc3b-499b-9650-3946c3f6b1e9 service nova] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0e45d804-f1d4-48cb-85a8-637dcd8509ef req-2f9c8a02-cc3b-499b-9650-3946c3f6b1e9 service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0e45d804-f1d4-48cb-85a8-637dcd8509ef req-2f9c8a02-cc3b-499b-9650-3946c3f6b1e9 service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0e45d804-f1d4-48cb-85a8-637dcd8509ef req-2f9c8a02-cc3b-499b-9650-3946c3f6b1e9 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] No waiting events found dispatching network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:08 user nova-compute[75305]: WARNING nova.compute.manager [req-0e45d804-f1d4-48cb-85a8-637dcd8509ef req-2f9c8a02-cc3b-499b-9650-3946c3f6b1e9 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received unexpected event network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 for instance with vm_state building and task_state spawning.
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "f5e23822-868e-4437-b87b-487179175d6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:10:10 user nova-compute[75305]: INFO nova.compute.claims [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Claim successful on node user
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:10:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Instance spawned successfully.
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:10 user nova-compute[75305]: INFO nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-15538b36-275e-4ba1-8849-1f3cc71c792b req-f3136c72-63bd-49b2-89ab-a8188b772bfd service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-15538b36-275e-4ba1-8849-1f3cc71c792b req-f3136c72-63bd-49b2-89ab-a8188b772bfd service nova] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-15538b36-275e-4ba1-8849-1f3cc71c792b req-f3136c72-63bd-49b2-89ab-a8188b772bfd service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-15538b36-275e-4ba1-8849-1f3cc71c792b req-f3136c72-63bd-49b2-89ab-a8188b772bfd service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-15538b36-275e-4ba1-8849-1f3cc71c792b req-f3136c72-63bd-49b2-89ab-a8188b772bfd service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] No waiting events found dispatching network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:10 user nova-compute[75305]: WARNING nova.compute.manager [req-15538b36-275e-4ba1-8849-1f3cc71c792b req-f3136c72-63bd-49b2-89ab-a8188b772bfd service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received unexpected event network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 for instance with vm_state building and task_state spawning.
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:10:10 user nova-compute[75305]: INFO nova.compute.manager [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Took 5.90 seconds to build instance.
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-97d59d20-2d82-4265-8985-9cbcdde5555c tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.997s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:10:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:10:10 user nova-compute[75305]: DEBUG nova.policy [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74b6bdb955524015ad1aec74ee466957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92869b8c2e246ca8f9d361c8ecabac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:10:10 user nova-compute[75305]: INFO nova.virt.block_device [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Booting with blank volume at /dev/vda
Nov 14 08:10:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:11 user nova-compute[75305]: DEBUG nova.network.neutron [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Successfully created port: 205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:10:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:11 user nova-compute[75305]: DEBUG nova.network.neutron [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Successfully updated port: 205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-changed-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Refreshing instance network info cache due to event network-changed-205f3177-c6be-4124-b32a-fe905fdb9493. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] Acquiring lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance network_info: |[{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] Acquired lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Refreshing network info cache for port 205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updated VIF entry in instance network info cache for port 205f3177-c6be-4124-b32a-fe905fdb9493. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd475528-fc93-45ba-86db-ddcae8703e07 req-8c3e8bdc-8a91-47b1-9839-55221fe1c251 service nova] Releasing lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG os_brick.utils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[558713de-27e9-491d-96e1-84ef0d081bf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a50b27a-30f3-43b2-b28a-ab66fd5a894b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a89ed8-f75d-4c9a-af54-2bf68b8fac0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e12bcd-2053-44ef-b4da-96b7e2e09ec9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:10:16 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:10:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9702af9-53c9-4a42-85a6-373219716e27]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG os_brick.utils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating existing volume attachment record: bda938c2-6421-41fc-9582-8d73cd0fdc77 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:10:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:21 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7651MB free_disk=25.20773696899414GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:10:21 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Creating image(s)
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Ensure instance console log exists: /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Start _get_guest_xml network_info=[{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'bda938c2-6421-41fc-9582-8d73cd0fdc77', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMNhyYjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5e23822-868e-4437-b87b-487179175d6c', 'attached_at': '', 'detached_at': '', 'volume_id': '3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'serial': '3a6f6dd4-a311-4876-850d-dcebf1e15f67'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f6ec11ae-2f25-4285-b810-ea4009d62c59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 10780135-d628-4567-9825-91df6d78dd22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance b495d719-82f6-48e8-9536-656d2f5513d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance dafc732a-81ec-412e-b237-1b18bd6cb577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:10:21 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:21 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMNhyYjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:10:21 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:10:21 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:10:21 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26526f6-8c0b-4efd-a655-7a5dee50af17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:10:21 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e91e3a-0ec7-4419-868c-76765edc7719]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67] added
Nov 14 08:10:21 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b5ea47-7ad7-4e9b-992a-69804eec0705]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef8ab11-771a-478d-8d13-593a709a1b03]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMNhyYjZ {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMNhyYjZ" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[df444b6c-38da-4a7d-8ee9-17b5837c6a3e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMNhyYjZ'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee26ed2b-5c56-413d-954f-a77ecb1cfb80]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[982aad35-7efb-40e0-9d95-8ac33a6f3530]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f5b60f-0445-4cd7-bdb4-3d662d9f1a31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260]
Nov 14 08:10:21 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260] successful.
Nov 14 08:10:21 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[605275e2-36f6-45c0-bc4a-c081577974f6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53217c1-7a42-41a4-85b7-8a2692d75d14]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:21 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa51992f-def7-453e-84de-71a1dcc96a84]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMNhyYjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:10:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23038613231626431', 'path': '/dev/sde'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038613231626431', 'path': '/dev/sde'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1305131567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1305131567',id=24,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-d068ubjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:11Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=f5e23822-868e-4437-b87b-487179175d6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.objects.instance [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'pci_devices' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:10:22 user nova-compute[75305]:   <uuid>f5e23822-868e-4437-b87b-487179175d6c</uuid>
Nov 14 08:10:22 user nova-compute[75305]:   <name>instance-00000018</name>
Nov 14 08:10:22 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:10:22 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:10:22 user nova-compute[75305]:   <metadata>
Nov 14 08:10:22 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:10:22 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:10:22 user nova-compute[75305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1305131567</nova:name>
Nov 14 08:10:22 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:10:21</nova:creationTime>
Nov 14 08:10:22 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:10:22 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:10:22 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:10:22 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:10:22 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:10:22 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:10:22 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:10:22 user nova-compute[75305]:       <nova:owner>
Nov 14 08:10:22 user nova-compute[75305]:         <nova:user uuid="74b6bdb955524015ad1aec74ee466957">tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member</nova:user>
Nov 14 08:10:22 user nova-compute[75305]:         <nova:project uuid="f92869b8c2e246ca8f9d361c8ecabac0">tempest-ServerBootFromVolumeStableRescueTest-983718269</nova:project>
Nov 14 08:10:22 user nova-compute[75305]:       </nova:owner>
Nov 14 08:10:22 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:10:22 user nova-compute[75305]:       <nova:ports>
Nov 14 08:10:22 user nova-compute[75305]:         <nova:port uuid="205f3177-c6be-4124-b32a-fe905fdb9493">
Nov 14 08:10:22 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:10:22 user nova-compute[75305]:         </nova:port>
Nov 14 08:10:22 user nova-compute[75305]:       </nova:ports>
Nov 14 08:10:22 user nova-compute[75305]:     </nova:instance>
Nov 14 08:10:22 user nova-compute[75305]:   </metadata>
Nov 14 08:10:22 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:10:22 user nova-compute[75305]:     <system>
Nov 14 08:10:22 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:10:22 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:10:22 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:10:22 user nova-compute[75305]:       <entry name="serial">f5e23822-868e-4437-b87b-487179175d6c</entry>
Nov 14 08:10:22 user nova-compute[75305]:       <entry name="uuid">f5e23822-868e-4437-b87b-487179175d6c</entry>
Nov 14 08:10:22 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:10:22 user nova-compute[75305]:     </system>
Nov 14 08:10:22 user nova-compute[75305]:   </sysinfo>
Nov 14 08:10:22 user nova-compute[75305]:   <os>
Nov 14 08:10:22 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:10:22 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:10:22 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:10:22 user nova-compute[75305]:   </os>
Nov 14 08:10:22 user nova-compute[75305]:   <features>
Nov 14 08:10:22 user nova-compute[75305]:     <acpi/>
Nov 14 08:10:22 user nova-compute[75305]:     <apic/>
Nov 14 08:10:22 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:10:22 user nova-compute[75305]:   </features>
Nov 14 08:10:22 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:10:22 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:10:22 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:10:22 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:10:22 user nova-compute[75305]:   </clock>
Nov 14 08:10:22 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:10:22 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:10:22 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:10:22 user nova-compute[75305]:   </cpu>
Nov 14 08:10:22 user nova-compute[75305]:   <devices>
Nov 14 08:10:22 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:10:22 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:10:22 user nova-compute[75305]:       <source dev="/dev/sde"/>
Nov 14 08:10:22 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:10:22 user nova-compute[75305]:       <serial>3a6f6dd4-a311-4876-850d-dcebf1e15f67</serial>
Nov 14 08:10:22 user nova-compute[75305]:     </disk>
Nov 14 08:10:22 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:10:22 user nova-compute[75305]:       <mac address="fa:16:3e:38:2f:79"/>
Nov 14 08:10:22 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:22 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:10:22 user nova-compute[75305]:       <target dev="tap205f3177-c6"/>
Nov 14 08:10:22 user nova-compute[75305]:     </interface>
Nov 14 08:10:22 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:10:22 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/console.log" append="off"/>
Nov 14 08:10:22 user nova-compute[75305]:     </serial>
Nov 14 08:10:22 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:10:22 user nova-compute[75305]:     <video>
Nov 14 08:10:22 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:22 user nova-compute[75305]:     </video>
Nov 14 08:10:22 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:10:22 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:10:22 user nova-compute[75305]:     </rng>
Nov 14 08:10:22 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:10:22 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:10:22 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:10:22 user nova-compute[75305]:     </memballoon>
Nov 14 08:10:22 user nova-compute[75305]:   </devices>
Nov 14 08:10:22 user nova-compute[75305]: </domain>
Nov 14 08:10:22 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1305131567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1305131567',id=24,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-d068ubjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:11Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=f5e23822-868e-4437-b87b-487179175d6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG os_vif [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3738ac1-ee27-5e54-8160-f33155a08c8d', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap205f3177-c6, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap205f3177-c6, col_values=(('qos', UUID('8c0582f8-c741-4f78-82e8-fdd1d6206f1e')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap205f3177-c6, col_values=(('external_ids', {'iface-id': '205f3177-c6be-4124-b32a-fe905fdb9493', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:2f:79', 'vm-uuid': 'f5e23822-868e-4437-b87b-487179175d6c'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:23 user nova-compute[75305]: INFO os_vif [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6')
Nov 14 08:10:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:10:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No VIF found with MAC fa:16:3e:38:2f:79, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:10:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updating instance_info_cache with network_info: [{"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-f6ec11ae-2f25-4285-b810-ea4009d62c59" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-ed7cdb4f-bf9d-4110-a348-83788cd41fb3 req-1d12068b-eaa7-419b-94b3-27cfa38b44de service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ed7cdb4f-bf9d-4110-a348-83788cd41fb3 req-1d12068b-eaa7-419b-94b3-27cfa38b44de service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ed7cdb4f-bf9d-4110-a348-83788cd41fb3 req-1d12068b-eaa7-419b-94b3-27cfa38b44de service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ed7cdb4f-bf9d-4110-a348-83788cd41fb3 req-1d12068b-eaa7-419b-94b3-27cfa38b44de service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-ed7cdb4f-bf9d-4110-a348-83788cd41fb3 req-1d12068b-eaa7-419b-94b3-27cfa38b44de service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:24 user nova-compute[75305]: WARNING nova.compute.manager [req-ed7cdb4f-bf9d-4110-a348-83788cd41fb3 req-1d12068b-eaa7-419b-94b3-27cfa38b44de service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state building and task_state spawning.
Nov 14 08:10:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:10:26 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance spawned successfully.
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-0179ea7e-29fd-46f5-91c9-769c7d499888 req-65e9bbfa-de64-446b-9a39-e5dbcac1fe3d service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0179ea7e-29fd-46f5-91c9-769c7d499888 req-65e9bbfa-de64-446b-9a39-e5dbcac1fe3d service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0179ea7e-29fd-46f5-91c9-769c7d499888 req-65e9bbfa-de64-446b-9a39-e5dbcac1fe3d service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0179ea7e-29fd-46f5-91c9-769c7d499888 req-65e9bbfa-de64-446b-9a39-e5dbcac1fe3d service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-0179ea7e-29fd-46f5-91c9-769c7d499888 req-65e9bbfa-de64-446b-9a39-e5dbcac1fe3d service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:26 user nova-compute[75305]: WARNING nova.compute.manager [req-0179ea7e-29fd-46f5-91c9-769c7d499888 req-65e9bbfa-de64-446b-9a39-e5dbcac1fe3d service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state building and task_state spawning.
Nov 14 08:10:26 user nova-compute[75305]: INFO nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 14 08:10:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:10:26 user nova-compute[75305]: INFO nova.compute.manager [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Took 16.63 seconds to build instance.
Nov 14 08:10:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dd8fa821-842b-4a3d-a0cd-17a8ab7ab3e7 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "f5e23822-868e-4437-b87b-487179175d6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.718s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:27 user nova-compute[75305]: INFO nova.compute.manager [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Unshelving
Nov 14 08:10:27 user nova-compute[75305]: INFO nova.virt.block_device [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Booting with volume 2afada73-2627-4b1a-a097-bac0bcf3c808 at /dev/vdc
Nov 14 08:10:27 user nova-compute[75305]: DEBUG os_brick.utils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c02cda-0d5a-425e-9387-8f76dd88d30c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9431e7-3e95-4059-80ff-6d5613e7c48b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fa479d-2c5f-4d38-bc05-4a9ec471c243]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a21dd2-1c69-4895-b770-54672c2787fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:10:27 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:10:27 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f3f28d-25b9-49de-9b8e-ae73172cd3dd]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG os_brick.utils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating existing volume attachment record: 625d1549-2944-4ea3-8429-130f399785d1 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:10:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'pci_requests' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'numa_topology' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:10:32 user nova-compute[75305]: INFO nova.compute.claims [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Claim successful on node user
Nov 14 08:10:32 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:32 user nova-compute[75305]: INFO nova.network.neutron [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating port 2fc26dc0-37ee-4285-bb22-ec1f1c206301 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 08:10:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquired lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing instance network info cache due to event network-changed-2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] Acquiring lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Releasing lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:10:34 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Creating image(s)
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'trusted_certs' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] Acquired lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG nova.network.neutron [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Refreshing network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<c837ffe0-c080-444e-a327-a7781f6d49bc> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "bd7b8e68574a4b7ea9109d94d1cdb8fead317638" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd7b8e68574a4b7ea9109d94d1cdb8fead317638" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG nova.virt.images [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] f1ba9c6b-2b8d-42aa-9882-134354a66656 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.part /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG nova.network.neutron [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updated VIF entry in instance network info cache for port 2fc26dc0-37ee-4285-bb22-ec1f1c206301. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG nova.network.neutron [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-85e3f045-4fe7-47a6-89e2-cc2361280bd1 req-dad02dde-c1ae-4445-8f37-f9a816604ecc service nova] Releasing lock "refresh_cache-c837ffe0-c080-444e-a327-a7781f6d49bc" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.part /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.converted" returned: 0 in 0.863s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd7b8e68574a4b7ea9109d94d1cdb8fead317638" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.612s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638 --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "bd7b8e68574a4b7ea9109d94d1cdb8fead317638" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd7b8e68574a4b7ea9109d94d1cdb8fead317638" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638 --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638,backing_fmt=raw /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638,backing_fmt=raw /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk 1073741824" returned: 0 in 0.053s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd7b8e68574a4b7ea9109d94d1cdb8fead317638" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638 --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'migration_context' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:38 user nova-compute[75305]: DEBUG nova.objects.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<c837ffe0-c080-444e-a327-a7781f6d49bc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:10:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Rebasing disk image.
Nov 14 08:10:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 -F raw /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 -F raw /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk" returned: 0 in 2.506s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Ensure instance console log exists: /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Start _get_guest_xml network_info=[{"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='dd8de5302eb6b1c6eaa7b70343d1e285',container_format='bare',created_at=2023-11-14T08:08:34Z,direct_url=<?>,disk_format='qcow2',id=f1ba9c6b-2b8d-42aa-9882-134354a66656,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-113716200-shelved',owner='7be86f7bfa9f4566a035ca96314ac1c7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T08:08:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '625d1549-2944-4ea3-8429-130f399785d1', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUYnQrIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c837ffe0-c080-444e-a327-a7781f6d49bc', 'attached_at': '', 'detached_at': '', 'volume_id': '2afada73-2627-4b1a-a097-bac0bcf3c808', 'serial': '2afada73-2627-4b1a-a097-bac0bcf3c808'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:10:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='dd8de5302eb6b1c6eaa7b70343d1e285',container_format='bare',created_at=2023-11-14T08:08:34Z,direct_url=<?>,disk_format='qcow2',id=f1ba9c6b-2b8d-42aa-9882-134354a66656,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-113716200-shelved',owner='7be86f7bfa9f4566a035ca96314ac1c7',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T08:08:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'vcpu_model' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.objects.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<c837ffe0-c080-444e-a327-a7781f6d49bc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUYnQrIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:10:40 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:10:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:10:40 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:10:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:10:40 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18feeee-965c-4afb-9c43-f6567883e3aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:10:40 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b440b027-ab71-429f-a1ab-4c6fa0fa69f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808] added
Nov 14 08:10:40 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d7999-3929-4219-bf6c-15ac5c5c39e9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522c482-78ce-40f9-bf12-eb3d767de65a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUYnQrIf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUYnQrIf" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55529fa-6828-47b4-9b69-00873a5eed92]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUYnQrIf'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb51a60-da95-4255-84bc-e5c2e37ad369]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da325e5c-5166-47ce-9444-2d22007e4edb]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbb5ec2-673c-4ecd-8034-0dffbe916496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260]
Nov 14 08:10:41 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260] successful.
Nov 14 08:10:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee742a-db1c-4b5b-a042-3ce09bef7ae3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d989f5-a7b1-4856-bb8a-5241f7b72078]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2004d541-4bac-4326-88f6-5d22c6ded01a]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:10:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUYnQrIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23031376533633062', 'path': '/dev/sdf'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031376533633062', 'path': '/dev/sdf'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-113716200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-113716200',id=18,image_ref='f1ba9c6b-2b8d-42aa-9882-134354a66656',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-146649035',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-obbnhka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member',shelved_at='2023-11-14T08:08:38.242532',shelved_host='user',shelved_image_id='f1ba9c6b-2b8d-42aa-9882-134354a66656'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=c837ffe0-c080-444e-a327-a7781f6d49bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'pci_devices' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.objects.base [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<c837ffe0-c080-444e-a327-a7781f6d49bc> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:10:42 user nova-compute[75305]:   <uuid>c837ffe0-c080-444e-a327-a7781f6d49bc</uuid>
Nov 14 08:10:42 user nova-compute[75305]:   <name>instance-00000012</name>
Nov 14 08:10:42 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:10:42 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:10:42 user nova-compute[75305]:   <metadata>
Nov 14 08:10:42 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:10:42 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:10:42 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-113716200</nova:name>
Nov 14 08:10:42 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:10:40</nova:creationTime>
Nov 14 08:10:42 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:10:42 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:10:42 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:10:42 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:10:42 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:10:42 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:10:42 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:10:42 user nova-compute[75305]:       <nova:owner>
Nov 14 08:10:42 user nova-compute[75305]:         <nova:user uuid="084e1f8ee4db4391b2d545926f45e659">tempest-AttachVolumeShelveTestJSON-488426726-project-member</nova:user>
Nov 14 08:10:42 user nova-compute[75305]:         <nova:project uuid="7be86f7bfa9f4566a035ca96314ac1c7">tempest-AttachVolumeShelveTestJSON-488426726</nova:project>
Nov 14 08:10:42 user nova-compute[75305]:       </nova:owner>
Nov 14 08:10:42 user nova-compute[75305]:       <nova:root type="image" uuid="f1ba9c6b-2b8d-42aa-9882-134354a66656"/>
Nov 14 08:10:42 user nova-compute[75305]:       <nova:ports>
Nov 14 08:10:42 user nova-compute[75305]:         <nova:port uuid="2fc26dc0-37ee-4285-bb22-ec1f1c206301">
Nov 14 08:10:42 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 08:10:42 user nova-compute[75305]:         </nova:port>
Nov 14 08:10:42 user nova-compute[75305]:       </nova:ports>
Nov 14 08:10:42 user nova-compute[75305]:     </nova:instance>
Nov 14 08:10:42 user nova-compute[75305]:   </metadata>
Nov 14 08:10:42 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:10:42 user nova-compute[75305]:     <system>
Nov 14 08:10:42 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:10:42 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:10:42 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:10:42 user nova-compute[75305]:       <entry name="serial">c837ffe0-c080-444e-a327-a7781f6d49bc</entry>
Nov 14 08:10:42 user nova-compute[75305]:       <entry name="uuid">c837ffe0-c080-444e-a327-a7781f6d49bc</entry>
Nov 14 08:10:42 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:10:42 user nova-compute[75305]:     </system>
Nov 14 08:10:42 user nova-compute[75305]:   </sysinfo>
Nov 14 08:10:42 user nova-compute[75305]:   <os>
Nov 14 08:10:42 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:10:42 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:10:42 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:10:42 user nova-compute[75305]:   </os>
Nov 14 08:10:42 user nova-compute[75305]:   <features>
Nov 14 08:10:42 user nova-compute[75305]:     <acpi/>
Nov 14 08:10:42 user nova-compute[75305]:     <apic/>
Nov 14 08:10:42 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:10:42 user nova-compute[75305]:   </features>
Nov 14 08:10:42 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:10:42 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:10:42 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:10:42 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:10:42 user nova-compute[75305]:   </clock>
Nov 14 08:10:42 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:10:42 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:10:42 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:10:42 user nova-compute[75305]:   </cpu>
Nov 14 08:10:42 user nova-compute[75305]:   <devices>
Nov 14 08:10:42 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:10:42 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:10:42 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk"/>
Nov 14 08:10:42 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:10:42 user nova-compute[75305]:     </disk>
Nov 14 08:10:42 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:10:42 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:10:42 user nova-compute[75305]:       <source dev="/dev/sdf"/>
Nov 14 08:10:42 user nova-compute[75305]:       <target dev="vdc" bus="virtio"/>
Nov 14 08:10:42 user nova-compute[75305]:       <serial>2afada73-2627-4b1a-a097-bac0bcf3c808</serial>
Nov 14 08:10:42 user nova-compute[75305]:     </disk>
Nov 14 08:10:42 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:10:42 user nova-compute[75305]:       <mac address="fa:16:3e:bb:f4:55"/>
Nov 14 08:10:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:42 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:10:42 user nova-compute[75305]:       <target dev="tap2fc26dc0-37"/>
Nov 14 08:10:42 user nova-compute[75305]:     </interface>
Nov 14 08:10:42 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:10:42 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/console.log" append="off"/>
Nov 14 08:10:42 user nova-compute[75305]:     </serial>
Nov 14 08:10:42 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:10:42 user nova-compute[75305]:     <video>
Nov 14 08:10:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:42 user nova-compute[75305]:     </video>
Nov 14 08:10:42 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:10:42 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:10:42 user nova-compute[75305]:     </rng>
Nov 14 08:10:42 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:10:42 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:10:42 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:10:42 user nova-compute[75305]:     </memballoon>
Nov 14 08:10:42 user nova-compute[75305]:   </devices>
Nov 14 08:10:42 user nova-compute[75305]: </domain>
Nov 14 08:10:42 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-113716200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-113716200',id=18,image_ref='f1ba9c6b-2b8d-42aa-9882-134354a66656',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-146649035',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:06:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-obbnhka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member',shelved_at='2023-11-14T08:08:38.242532',shelved_host='user',shelved_image_id='f1ba9c6b-2b8d-42aa-9882-134354a66656'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=c837ffe0-c080-444e-a327-a7781f6d49bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG os_vif [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4229a917-74a6-5c31-ad67-ea28d01c482f', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fc26dc0-37, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2fc26dc0-37, col_values=(('qos', UUID('c82e7d3b-7884-473f-8f28-e2d8eb422b65')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2fc26dc0-37, col_values=(('external_ids', {'iface-id': '2fc26dc0-37ee-4285-bb22-ec1f1c206301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:f4:55', 'vm-uuid': 'c837ffe0-c080-444e-a327-a7781f6d49bc'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:42 user nova-compute[75305]: INFO os_vif [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37')
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:10:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No VIF found with MAC fa:16:3e:bb:f4:55, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-changed-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Refreshing instance network info cache due to event network-changed-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] Acquiring lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] Acquired lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Refreshing network info cache for port 3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Updated VIF entry in instance network info cache for port 3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Updating instance_info_cache with network_info: [{"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2ead44ca-30ab-4472-807e-3d465f7796a0 req-214de704-8f13-4fd2-afcd-f051aa71180a service nova] Releasing lock "refresh_cache-b495d719-82f6-48e8-9536-656d2f5513d3" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid b495d719-82f6-48e8-9536-656d2f5513d3 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:45 user nova-compute[75305]: INFO nova.compute.manager [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Attaching volume c799ce22-1a94-4cc3-adce-1d19b4dd05e1 to /dev/vdb
Nov 14 08:10:45 user nova-compute[75305]: DEBUG os_brick.utils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:45 user nova-compute[75305]: WARNING nova.compute.manager [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 08:10:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:45 user nova-compute[75305]: WARNING nova.compute.manager [req-616a39a7-661b-431f-bb26-8c91fecd1b7a req-f64d8680-30fe-4e51-8273-611bcf0b6604 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[300530e1-24aa-4be3-b411-0297b8aa3536]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a05926-da4f-4d11-a269-97e74e60c5e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fb0d7b-8138-454e-81ad-07fc4a9a6d19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8398b4c-0a8c-4a75-9010-48cf5241faeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:10:45 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:10:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f401eb64-b70c-45d1-848e-7bd6f2807b9e]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG os_brick.utils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Updating existing volume attachment record: 185ff6a6-70cc-4331-8ac5-82eb9e8bc3a7 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:10:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:10:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:10:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance spawned successfully.
Nov 14 08:10:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:10:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cca42d75-2587-4410-9991-f6930a4cc193 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.662s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:10:49 user nova-compute[75305]: INFO nova.compute.claims [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Claim successful on node user
Nov 14 08:10:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.network.neutron [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:10:49 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:10:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG nova.policy [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94942948e4d34e53bf9acfd04de75d8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd97b980e3aa04e5392d096152dd3999a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:10:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Creating image(s)
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "/opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "/opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhFImvSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:10:50 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:10:50 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:10:50 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[938806d3-ba5e-40d8-875f-09e5b646617e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:10:50 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a991565-8910-44b3-9719-86ff3054485b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1] added
Nov 14 08:10:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee688e67-b3bf-4002-9e53-6ff411e010b3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[db883371-060a-4546-9dd7-e157118e11ef]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhFImvSE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OhFImvSE" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5082a6-a5e8-4d2d-80fe-d0c16632ea5a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OhFImvSE'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a6545-e31b-460b-8c11-c9b1084d4f0d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0696a6-1ea7-462b-a658-f89c1197f274]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd384beb-655c-43d4-9e6e-f3786ce68bcf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260]
Nov 14 08:10:50 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260] successful.
Nov 14 08:10:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.203s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b99b9de-7f1b-4819-8bcb-9dd9553ffc07]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk 1073741824" returned: 0 in 0.067s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd43a11-0d34-422b-84b6-de7675830b68]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)
Nov 14 08:10:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.453s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0e41a7-283a-4e63-bdcb-9b8fb61c89be]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhFImvSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.211s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:50 user nova-compute[75305]: DEBUG nova.network.neutron [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Successfully created port: 82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Cannot resize image /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Ensure instance console log exists: /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.network.neutron [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Successfully updated port: 82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquired lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.network.neutron [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.517s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== connect_volume: return (1518ms) {'type': 'block', 'scsi_wwn': '26134636161353265', 'path': '/dev/sdg'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134636161353265', 'path': '/dev/sdg'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.objects.instance [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid b495d719-82f6-48e8-9536-656d2f5513d3 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.network.neutron [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:10:51 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:10:51 user nova-compute[75305]:   <source dev="/dev/sdg"/>
Nov 14 08:10:51 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:10:51 user nova-compute[75305]:   <serial>c799ce22-1a94-4cc3-adce-1d19b4dd05e1</serial>
Nov 14 08:10:51 user nova-compute[75305]: </disk>
Nov 14 08:10:51 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-changed-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Refreshing instance network info cache due to event network-changed-82107e76-9d06-4dd8-917b-6c9a81233786. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:10:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] Acquiring lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Updating instance_info_cache with network_info: [{"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Releasing lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Instance network_info: |[{"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] Acquired lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Refreshing network info cache for port 82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Start _get_guest_xml network_info=[{"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:10:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1378329075',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1378329075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1378329',id=25,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlxnujSFPoyR39a/VyKocIqSuQLpfcrKioIlw296VdABDsDs8L70TCUgMCqb4FWlEHBv+mfoDmkGhdrn7BanfjWEafRNaa8Qn7Tj8ied4McdSc0XXHMbHonVRTLh/Db7Q==',key_name='tempest-keypair-1259986227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d97b980e3aa04e5392d096152dd3999a',ramdisk_id='',reservation_id='r-0ha90lai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1599136510',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94942948e4d34e53bf9acfd04de75d8e',uuid=3c079358-a5f6-4294-84e9-df23abb78b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Converting VIF {"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f7:0f,bridge_name='br-int',has_traffic_filtering=True,id=82107e76-9d06-4dd8-917b-6c9a81233786,network=Network(6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82107e76-9d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.objects.instance [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c079358-a5f6-4294-84e9-df23abb78b90 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:10:52 user nova-compute[75305]:   <uuid>3c079358-a5f6-4294-84e9-df23abb78b90</uuid>
Nov 14 08:10:52 user nova-compute[75305]:   <name>instance-00000019</name>
Nov 14 08:10:52 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:10:52 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:10:52 user nova-compute[75305]:   <metadata>
Nov 14 08:10:52 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:10:52 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:10:52 user nova-compute[75305]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1378329075</nova:name>
Nov 14 08:10:52 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:10:52</nova:creationTime>
Nov 14 08:10:52 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:10:52 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:10:52 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:10:52 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:10:52 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:10:52 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:10:52 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:10:52 user nova-compute[75305]:       <nova:owner>
Nov 14 08:10:52 user nova-compute[75305]:         <nova:user uuid="94942948e4d34e53bf9acfd04de75d8e">tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member</nova:user>
Nov 14 08:10:52 user nova-compute[75305]:         <nova:project uuid="d97b980e3aa04e5392d096152dd3999a">tempest-TestServerVolumeAttachScenarioOldVersion-1599136510</nova:project>
Nov 14 08:10:52 user nova-compute[75305]:       </nova:owner>
Nov 14 08:10:52 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:10:52 user nova-compute[75305]:       <nova:ports>
Nov 14 08:10:52 user nova-compute[75305]:         <nova:port uuid="82107e76-9d06-4dd8-917b-6c9a81233786">
Nov 14 08:10:52 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 08:10:52 user nova-compute[75305]:         </nova:port>
Nov 14 08:10:52 user nova-compute[75305]:       </nova:ports>
Nov 14 08:10:52 user nova-compute[75305]:     </nova:instance>
Nov 14 08:10:52 user nova-compute[75305]:   </metadata>
Nov 14 08:10:52 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:10:52 user nova-compute[75305]:     <system>
Nov 14 08:10:52 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:10:52 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:10:52 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:10:52 user nova-compute[75305]:       <entry name="serial">3c079358-a5f6-4294-84e9-df23abb78b90</entry>
Nov 14 08:10:52 user nova-compute[75305]:       <entry name="uuid">3c079358-a5f6-4294-84e9-df23abb78b90</entry>
Nov 14 08:10:52 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:10:52 user nova-compute[75305]:     </system>
Nov 14 08:10:52 user nova-compute[75305]:   </sysinfo>
Nov 14 08:10:52 user nova-compute[75305]:   <os>
Nov 14 08:10:52 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:10:52 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:10:52 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:10:52 user nova-compute[75305]:   </os>
Nov 14 08:10:52 user nova-compute[75305]:   <features>
Nov 14 08:10:52 user nova-compute[75305]:     <acpi/>
Nov 14 08:10:52 user nova-compute[75305]:     <apic/>
Nov 14 08:10:52 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:10:52 user nova-compute[75305]:   </features>
Nov 14 08:10:52 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:10:52 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:10:52 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:10:52 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:10:52 user nova-compute[75305]:   </clock>
Nov 14 08:10:52 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:10:52 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:10:52 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:10:52 user nova-compute[75305]:   </cpu>
Nov 14 08:10:52 user nova-compute[75305]:   <devices>
Nov 14 08:10:52 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:10:52 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:10:52 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk"/>
Nov 14 08:10:52 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:10:52 user nova-compute[75305]:     </disk>
Nov 14 08:10:52 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:10:52 user nova-compute[75305]:       <mac address="fa:16:3e:c3:f7:0f"/>
Nov 14 08:10:52 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:52 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:10:52 user nova-compute[75305]:       <target dev="tap82107e76-9d"/>
Nov 14 08:10:52 user nova-compute[75305]:     </interface>
Nov 14 08:10:52 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:10:52 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/console.log" append="off"/>
Nov 14 08:10:52 user nova-compute[75305]:     </serial>
Nov 14 08:10:52 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:10:52 user nova-compute[75305]:     <video>
Nov 14 08:10:52 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:10:52 user nova-compute[75305]:     </video>
Nov 14 08:10:52 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:10:52 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:10:52 user nova-compute[75305]:     </rng>
Nov 14 08:10:52 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:10:52 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:10:52 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:10:52 user nova-compute[75305]:     </memballoon>
Nov 14 08:10:52 user nova-compute[75305]:   </devices>
Nov 14 08:10:52 user nova-compute[75305]: </domain>
Nov 14 08:10:52 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1378329075',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1378329075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1378329',id=25,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlxnujSFPoyR39a/VyKocIqSuQLpfcrKioIlw296VdABDsDs8L70TCUgMCqb4FWlEHBv+mfoDmkGhdrn7BanfjWEafRNaa8Qn7Tj8ied4McdSc0XXHMbHonVRTLh/Db7Q==',key_name='tempest-keypair-1259986227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d97b980e3aa04e5392d096152dd3999a',ramdisk_id='',reservation_id='r-0ha90lai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1599136510',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94942948e4d34e53bf9acfd04de75d8e',uuid=3c079358-a5f6-4294-84e9-df23abb78b90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Converting VIF {"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f7:0f,bridge_name='br-int',has_traffic_filtering=True,id=82107e76-9d06-4dd8-917b-6c9a81233786,network=Network(6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82107e76-9d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG os_vif [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f7:0f,bridge_name='br-int',has_traffic_filtering=True,id=82107e76-9d06-4dd8-917b-6c9a81233786,network=Network(6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82107e76-9d') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b97beea7-92b3-58ee-8f3c-6224de4317a2', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82107e76-9d, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82107e76-9d, col_values=(('qos', UUID('6a5720ba-2bfd-4283-8760-e9e8756658e7')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82107e76-9d, col_values=(('external_ids', {'iface-id': '82107e76-9d06-4dd8-917b-6c9a81233786', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:f7:0f', 'vm-uuid': '3c079358-a5f6-4294-84e9-df23abb78b90'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No VIF found with MAC fa:16:3e:de:98:5e, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:52 user nova-compute[75305]: INFO os_vif [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:f7:0f,bridge_name='br-int',has_traffic_filtering=True,id=82107e76-9d06-4dd8-917b-6c9a81233786,network=Network(6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82107e76-9d')
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] No VIF found with MAC fa:16:3e:c3:f7:0f, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-781e6091-1a01-4a5f-8a4c-e0ceea45d5d5 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.330s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Updated VIF entry in instance network info cache for port 82107e76-9d06-4dd8-917b-6c9a81233786. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Updating instance_info_cache with network_info: [{"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9ffa8b5b-4f96-453a-9eea-7d1b9da8f977 req-cbdc1ed2-b5c9-46a2-84c2-c753bc49cdb5 service nova] Releasing lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:53 user nova-compute[75305]: INFO nova.compute.manager [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Detaching volume c799ce22-1a94-4cc3-adce-1d19b4dd05e1
Nov 14 08:10:53 user nova-compute[75305]: INFO nova.virt.block_device [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Attempting to driver detach volume c799ce22-1a94-4cc3-adce-1d19b4dd05e1 from mountpoint /dev/vdb
Nov 14 08:10:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Attempting to detach device vdb from instance b495d719-82f6-48e8-9536-656d2f5513d3 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:10:53 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:10:53 user nova-compute[75305]:   <source dev="/dev/sdg"/>
Nov 14 08:10:53 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:10:53 user nova-compute[75305]:   <serial>c799ce22-1a94-4cc3-adce-1d19b4dd05e1</serial>
Nov 14 08:10:53 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:10:53 user nova-compute[75305]: </disk>
Nov 14 08:10:53 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:10:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully detached device vdb from instance b495d719-82f6-48e8-9536-656d2f5513d3 from the persistent domain config.
Nov 14 08:10:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b495d719-82f6-48e8-9536-656d2f5513d3 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:10:53 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:10:53 user nova-compute[75305]:   <source dev="/dev/sdg"/>
Nov 14 08:10:53 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:10:53 user nova-compute[75305]:   <serial>c799ce22-1a94-4cc3-adce-1d19b4dd05e1</serial>
Nov 14 08:10:53 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:10:53 user nova-compute[75305]: </disk>
Nov 14 08:10:53 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-473cb660-344b-47e2-84b9-85d23c19e9bb req-190107e1-7f2d-4758-a1ac-3b05f97f0fc0 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-473cb660-344b-47e2-84b9-85d23c19e9bb req-190107e1-7f2d-4758-a1ac-3b05f97f0fc0 service nova] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-473cb660-344b-47e2-84b9-85d23c19e9bb req-190107e1-7f2d-4758-a1ac-3b05f97f0fc0 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-473cb660-344b-47e2-84b9-85d23c19e9bb req-190107e1-7f2d-4758-a1ac-3b05f97f0fc0 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-473cb660-344b-47e2-84b9-85d23c19e9bb req-190107e1-7f2d-4758-a1ac-3b05f97f0fc0 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] No waiting events found dispatching network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:54 user nova-compute[75305]: WARNING nova.compute.manager [req-473cb660-344b-47e2-84b9-85d23c19e9bb req-190107e1-7f2d-4758-a1ac-3b05f97f0fc0 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received unexpected event network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 for instance with vm_state building and task_state spawning.
Nov 14 08:10:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b495d719-82f6-48e8-9536-656d2f5513d3 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:10:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:55 user nova-compute[75305]: INFO nova.compute.manager [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Detaching volume c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:10:55 user nova-compute[75305]: INFO nova.virt.block_device [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Attempting to driver detach volume c6570597-882f-4c7c-8d5d-b12f8552ad16 from mountpoint /dev/vdb
Nov 14 08:10:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Attempting to detach device vdb from instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:10:55 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:10:55 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:10:55 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:10:55 user nova-compute[75305]:   <serial>c6570597-882f-4c7c-8d5d-b12f8552ad16</serial>
Nov 14 08:10:55 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:10:55 user nova-compute[75305]: </disk>
Nov 14 08:10:55 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:10:55 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully detached device vdb from instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e from the persistent domain config.
Nov 14 08:10:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:10:55 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:10:55 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:10:55 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:10:55 user nova-compute[75305]:   <serial>c6570597-882f-4c7c-8d5d-b12f8552ad16</serial>
Nov 14 08:10:55 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:10:55 user nova-compute[75305]: </disk>
Nov 14 08:10:55 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:55 user nova-compute[75305]: INFO nova.compute.manager [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Terminating instance
Nov 14 08:10:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-58931e3e-e751-4d4a-b43b-e5a87b68a25c req-ddeb35d5-a790-46c3-b968-3afe17c2df48 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-58931e3e-e751-4d4a-b43b-e5a87b68a25c req-ddeb35d5-a790-46c3-b968-3afe17c2df48 service nova] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-58931e3e-e751-4d4a-b43b-e5a87b68a25c req-ddeb35d5-a790-46c3-b968-3afe17c2df48 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-58931e3e-e751-4d4a-b43b-e5a87b68a25c req-ddeb35d5-a790-46c3-b968-3afe17c2df48 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-58931e3e-e751-4d4a-b43b-e5a87b68a25c req-ddeb35d5-a790-46c3-b968-3afe17c2df48 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] No waiting events found dispatching network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:56 user nova-compute[75305]: WARNING nova.compute.manager [req-58931e3e-e751-4d4a-b43b-e5a87b68a25c req-ddeb35d5-a790-46c3-b968-3afe17c2df48 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received unexpected event network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 for instance with vm_state building and task_state spawning.
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-d60c3f19-85a1-4f09-863c-687a371cbf86 req-2e6f8e86-8f81-49d4-9d1c-7225e592b7fa service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d60c3f19-85a1-4f09-863c-687a371cbf86 req-2e6f8e86-8f81-49d4-9d1c-7225e592b7fa service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d60c3f19-85a1-4f09-863c-687a371cbf86 req-2e6f8e86-8f81-49d4-9d1c-7225e592b7fa service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d60c3f19-85a1-4f09-863c-687a371cbf86 req-2e6f8e86-8f81-49d4-9d1c-7225e592b7fa service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-d60c3f19-85a1-4f09-863c-687a371cbf86 req-2e6f8e86-8f81-49d4-9d1c-7225e592b7fa service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-d60c3f19-85a1-4f09-863c-687a371cbf86 req-2e6f8e86-8f81-49d4-9d1c-7225e592b7fa service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-unplugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:10:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Instance destroyed successfully.
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lazy-loading 'resources' on Instance uuid ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-559180561',display_name='tempest-ServerActionsTestOtherB-server-559180561',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-559180561',id=5,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7hXx+Yx9VC01uEKYPztCuj0R9JTutmZFM++Z4rXdfJnnvAIcSuh31cpMNLqp65HXoXD+vKapyJ9EDYNkvFzNUGW3gr/giArPpTA8UOJ7yzZ74lFUodnLlC3x172DDGcA==',key_name='tempest-keypair-39057614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd8b5236976e4be48b494cdbc69015b4',ramdisk_id='',reservation_id='r-909jzpxh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1488485775',owner_user_name='tempest-ServerActionsTestOtherB-1488485775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:08:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7dda8620115b4ad5a5acc0c811ef44ee',uuid=ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converting VIF {"id": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "address": "fa:16:3e:ed:e6:07", "network": {"id": "c89df9b9-6bfb-466c-ab7f-3d467876d174", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1568265897-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8b5236976e4be48b494cdbc69015b4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f99886b-aa", "ovs_interfaceid": "9f99886b-aaf5-4e84-a5d2-2e74015f4386", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_vif [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f99886b-aa, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d232205-c3e9-49a8-8011-2b4e7fa482b4) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:56 user nova-compute[75305]: INFO os_vif [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e6:07,bridge_name='br-int',has_traffic_filtering=True,id=9f99886b-aaf5-4e84-a5d2-2e74015f4386,network=Network(c89df9b9-6bfb-466c-ab7f-3d467876d174),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f99886b-aa')
Nov 14 08:10:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vFYybEUk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:10:56 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22409e7-57fc-4fe0-aaa3-3bba2a16068e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:10:56 user nova-compute[75305]: No targets found.
Nov 14 08:10:56 user nova-compute[75305]: iSNS:
Nov 14 08:10:56 user nova-compute[75305]: No targets found.
Nov 14 08:10:56 user nova-compute[75305]: STATIC:
Nov 14 08:10:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1
Nov 14 08:10:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:10:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:10:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185
Nov 14 08:10:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:10:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:10:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33
Nov 14 08:10:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:10:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:10:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808
Nov 14 08:10:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:10:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:10:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:10:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:10:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:10:56 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:10:56 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:10:56 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:10:56 user nova-compute[75305]: FIRMWARE:
Nov 14 08:10:56 user nova-compute[75305]: No targets found.
Nov 14 08:10:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:10:56 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:10:56 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bfeeb1-4e49-4adf-b015-2c86921c2768]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b1c5a-8ec9-445d-9f7c-1fcf6a8807ae]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)
Nov 14 08:10:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442aaa70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe9b53d-a368-485b-b356-e32f0a2eb1cc]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c7ba10-d134-4dcf-90e9-f1b80af1cfcc]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Instance spawned successfully.
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50f9f43-96fb-43d5-a184-1db91d007e43]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb01931d-ef8b-482a-a5a6-0b7dc06976e7]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2472eb7-08b1-4b46-aee0-018fca794ae4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:57 user nova-compute[75305]: INFO nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Took 7.03 seconds to spawn the instance on the hypervisor.
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[abccc1ca-4ae5-4058-92ca-3c1a6decee2b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260]
Nov 14 08:10:57 user nova-compute[75305]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33, portal: 172.16.0.220,3260] successful.
Nov 14 08:10:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47c805e5-5129-493e-94e7-1fd4a5235d33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec8b8a-73e1-468f-b0c6-9b81bdaa6067]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] <== disconnect_volume: return (377ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:10:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Deleting instance files /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace_del
Nov 14 08:10:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Deletion of /opt/stack/data/nova/instances/ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace_del complete
Nov 14 08:10:57 user nova-compute[75305]: INFO nova.compute.manager [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Took 8.05 seconds to build instance.
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-027ad8e7-2ec6-4388-b83c-d7f66a14139c tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.197s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:57 user nova-compute[75305]: INFO nova.compute.manager [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:57 user nova-compute[75305]: INFO nova.compute.manager [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Terminating instance
Nov 14 08:10:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Instance destroyed successfully.
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.objects.instance [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lazy-loading 'resources' on Instance uuid f6ec11ae-2f25-4285-b810-ea4009d62c59 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2105155944',display_name='tempest-ServersNegativeTestJSON-server-2105155944',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2105155944',id=2,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='527bf1ca93e8450293e5228c6ee1931f',ramdisk_id='',reservation_id='r-g8aru86p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-281828421',owner_user_name='tempest-ServersNegativeTestJSON-281828421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:35Z,user_data=None,user_id='b6126101718a429183c2553d9b552360',uuid=f6ec11ae-2f25-4285-b810-ea4009d62c59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converting VIF {"id": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "address": "fa:16:3e:2f:f7:e3", "network": {"id": "c816e58a-0ba7-44fe-af8a-50c919dd4af3", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-967502016-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "527bf1ca93e8450293e5228c6ee1931f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18fcd91e-06", "ovs_interfaceid": "18fcd91e-06c0-40f6-99e4-fd3b7f2e4222", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f7:e3,bridge_name='br-int',has_traffic_filtering=True,id=18fcd91e-06c0-40f6-99e4-fd3b7f2e4222,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fcd91e-06') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG os_vif [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f7:e3,bridge_name='br-int',has_traffic_filtering=True,id=18fcd91e-06c0-40f6-99e4-fd3b7f2e4222,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fcd91e-06') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18fcd91e-06, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eef92460-c743-439a-8a50-8fa7e7473ac1) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:10:58 user nova-compute[75305]: INFO os_vif [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:f7:e3,bridge_name='br-int',has_traffic_filtering=True,id=18fcd91e-06c0-40f6-99e4-fd3b7f2e4222,network=Network(c816e58a-0ba7-44fe-af8a-50c919dd4af3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18fcd91e-06')
Nov 14 08:10:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Deleting instance files /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59_del
Nov 14 08:10:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Deletion of /opt/stack/data/nova/instances/f6ec11ae-2f25-4285-b810-ea4009d62c59_del complete
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] Acquiring lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] No waiting events found dispatching network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:10:58 user nova-compute[75305]: WARNING nova.compute.manager [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received unexpected event network-vif-plugged-9f99886b-aaf5-4e84-a5d2-2e74015f4386 for instance with vm_state active and task_state deleting.
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Received event network-vif-deleted-9f99886b-aaf5-4e84-a5d2-2e74015f4386 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:10:58 user nova-compute[75305]: INFO nova.compute.manager [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Neutron deleted interface 9f99886b-aaf5-4e84-a5d2-2e74015f4386; detaching it from the instance and deleting it from the info cache
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.network.neutron [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-3f0f5442-60f2-48a1-acf6-3ac0bc288d75 req-58cb8f44-79bb-4f84-a524-989b72e9b50c service nova] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Detach interface failed, port_id=9f99886b-aaf5-4e84-a5d2-2e74015f4386, reason: Instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:10:58 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Took 1.22 seconds to deallocate network for instance.
Nov 14 08:10:58 user nova-compute[75305]: INFO nova.compute.manager [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 14 08:10:58 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:10:58 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:10:59 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:10:59 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Took 0.58 seconds to deallocate network for instance.
Nov 14 08:10:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:59 user nova-compute[75305]: INFO nova.compute.manager [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] [instance: ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace] Took 0.92 seconds to detach 1 volumes for instance.
Nov 14 08:10:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:10:59 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:10:59 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:10:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:10:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.154s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:10:59 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Deleted allocations for instance f6ec11ae-2f25-4285-b810-ea4009d62c59
Nov 14 08:10:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fea5d88b-f2d9-41ff-aa11-b9ede514e780 tempest-ServersNegativeTestJSON-281828421 tempest-ServersNegativeTestJSON-281828421-project-member] Lock "f6ec11ae-2f25-4285-b810-ea4009d62c59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.081s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:00 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:11:00 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:11:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:00 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Deleted allocations for instance ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace
Nov 14 08:11:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6d6d63b7-f545-4916-9611-98c0d1f83fca tempest-ServerActionsTestOtherB-1488485775 tempest-ServerActionsTestOtherB-1488485775-project-member] Lock "ab6f30a8-8663-46d8-bcfd-ae0d1b0a5ace" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.399s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-659858a1-5aa4-403e-8a87-3a6a47c9596d req-e34532ee-7172-4634-ba21-768c3da794b5 service nova] [instance: f6ec11ae-2f25-4285-b810-ea4009d62c59] Received event network-vif-deleted-18fcd91e-06c0-40f6-99e4-fd3b7f2e4222 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:11:08 user nova-compute[75305]: INFO nova.compute.claims [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Claim successful on node user
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:11:09 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.policy [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26ebac86c4d845d5a2d3ebc50d9d919e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5598d280de473f96c6d0f3500a7a9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:11:09 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Creating image(s)
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "/opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "/opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk 1073741824" returned: 0 in 0.061s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing instance network info cache due to event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Successfully created port: eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Cannot resize image /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Ensure instance console log exists: /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Successfully updated port: eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquired lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updated VIF entry in instance network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-01be019a-9ece-44c4-b77f-a8ca67ed3cb8 req-71cb1737-b0ab-4516-8a0d-e98ab624b734 service nova] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-changed-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Refreshing instance network info cache due to event network-changed-eac08684-f54c-4430-898e-099dcd15a69d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] Acquiring lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:11:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Updating instance_info_cache with network_info: [{"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Releasing lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Instance network_info: |[{"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] Acquired lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Refreshing network info cache for port eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Start _get_guest_xml network_info=[{"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:11:11 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:11:11 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1298423447',display_name='tempest-VolumesAdminNegativeTest-server-1298423447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1298423447',id=26,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsdAw/u3j3EXSBLIf425rc0/tBzRYQC5N7OlVDbAdaDgKCamGhwkKekJXDV2d3Lm1lus7vaQTktqWB5/fvDCmiGti+t4OEGTxNnorO7wy5vj+gJkT2Lc7/3HG7aw9juhA==',key_name='tempest-keypair-2098536338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5598d280de473f96c6d0f3500a7a9c',ramdisk_id='',reservation_id='r-jstwphjj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1378224790',owner_user_name='tempest-VolumesAdminNegativeTest-1378224790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ebac86c4d845d5a2d3ebc50d9d919e',uuid=fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converting VIF {"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:4a,bridge_name='br-int',has_traffic_filtering=True,id=eac08684-f54c-4430-898e-099dcd15a69d,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac08684-f5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lazy-loading 'pci_devices' on Instance uuid fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:11:11 user nova-compute[75305]:   <uuid>fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d</uuid>
Nov 14 08:11:11 user nova-compute[75305]:   <name>instance-0000001a</name>
Nov 14 08:11:11 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:11:11 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:11:11 user nova-compute[75305]:   <metadata>
Nov 14 08:11:11 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:11:11 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:11:11 user nova-compute[75305]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1298423447</nova:name>
Nov 14 08:11:11 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:11:11</nova:creationTime>
Nov 14 08:11:11 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:11:11 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:11:11 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:11:11 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:11:11 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:11:11 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:11:11 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:11:11 user nova-compute[75305]:       <nova:owner>
Nov 14 08:11:11 user nova-compute[75305]:         <nova:user uuid="26ebac86c4d845d5a2d3ebc50d9d919e">tempest-VolumesAdminNegativeTest-1378224790-project-member</nova:user>
Nov 14 08:11:11 user nova-compute[75305]:         <nova:project uuid="ae5598d280de473f96c6d0f3500a7a9c">tempest-VolumesAdminNegativeTest-1378224790</nova:project>
Nov 14 08:11:11 user nova-compute[75305]:       </nova:owner>
Nov 14 08:11:11 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:11:11 user nova-compute[75305]:       <nova:ports>
Nov 14 08:11:11 user nova-compute[75305]:         <nova:port uuid="eac08684-f54c-4430-898e-099dcd15a69d">
Nov 14 08:11:11 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 08:11:11 user nova-compute[75305]:         </nova:port>
Nov 14 08:11:11 user nova-compute[75305]:       </nova:ports>
Nov 14 08:11:11 user nova-compute[75305]:     </nova:instance>
Nov 14 08:11:11 user nova-compute[75305]:   </metadata>
Nov 14 08:11:11 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:11:11 user nova-compute[75305]:     <system>
Nov 14 08:11:11 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:11:11 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:11:11 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:11:11 user nova-compute[75305]:       <entry name="serial">fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d</entry>
Nov 14 08:11:11 user nova-compute[75305]:       <entry name="uuid">fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d</entry>
Nov 14 08:11:11 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:11:11 user nova-compute[75305]:     </system>
Nov 14 08:11:11 user nova-compute[75305]:   </sysinfo>
Nov 14 08:11:11 user nova-compute[75305]:   <os>
Nov 14 08:11:11 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:11:11 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:11:11 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:11:11 user nova-compute[75305]:   </os>
Nov 14 08:11:11 user nova-compute[75305]:   <features>
Nov 14 08:11:11 user nova-compute[75305]:     <acpi/>
Nov 14 08:11:11 user nova-compute[75305]:     <apic/>
Nov 14 08:11:11 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:11:11 user nova-compute[75305]:   </features>
Nov 14 08:11:11 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:11:11 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:11:11 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:11:11 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:11:11 user nova-compute[75305]:   </clock>
Nov 14 08:11:11 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:11:11 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:11:11 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:11:11 user nova-compute[75305]:   </cpu>
Nov 14 08:11:11 user nova-compute[75305]:   <devices>
Nov 14 08:11:11 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:11:11 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:11:11 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk"/>
Nov 14 08:11:11 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:11:11 user nova-compute[75305]:     </disk>
Nov 14 08:11:11 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:11:11 user nova-compute[75305]:       <mac address="fa:16:3e:95:2b:4a"/>
Nov 14 08:11:11 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:11:11 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:11:11 user nova-compute[75305]:       <target dev="tapeac08684-f5"/>
Nov 14 08:11:11 user nova-compute[75305]:     </interface>
Nov 14 08:11:11 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:11:11 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/console.log" append="off"/>
Nov 14 08:11:11 user nova-compute[75305]:     </serial>
Nov 14 08:11:11 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:11:11 user nova-compute[75305]:     <video>
Nov 14 08:11:11 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:11:11 user nova-compute[75305]:     </video>
Nov 14 08:11:11 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:11:11 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:11:11 user nova-compute[75305]:     </rng>
Nov 14 08:11:11 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:11:11 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:11:11 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:11:11 user nova-compute[75305]:     </memballoon>
Nov 14 08:11:11 user nova-compute[75305]:   </devices>
Nov 14 08:11:11 user nova-compute[75305]: </domain>
Nov 14 08:11:11 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1298423447',display_name='tempest-VolumesAdminNegativeTest-server-1298423447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1298423447',id=26,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsdAw/u3j3EXSBLIf425rc0/tBzRYQC5N7OlVDbAdaDgKCamGhwkKekJXDV2d3Lm1lus7vaQTktqWB5/fvDCmiGti+t4OEGTxNnorO7wy5vj+gJkT2Lc7/3HG7aw9juhA==',key_name='tempest-keypair-2098536338',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5598d280de473f96c6d0f3500a7a9c',ramdisk_id='',reservation_id='r-jstwphjj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1378224790',owner_user_name='tempest-VolumesAdminNegativeTest-1378224790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ebac86c4d845d5a2d3ebc50d9d919e',uuid=fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converting VIF {"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:4a,bridge_name='br-int',has_traffic_filtering=True,id=eac08684-f54c-4430-898e-099dcd15a69d,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac08684-f5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG os_vif [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:4a,bridge_name='br-int',has_traffic_filtering=True,id=eac08684-f54c-4430-898e-099dcd15a69d,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac08684-f5') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44cc9b79-c31b-5c5f-b798-8f482454cd61', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeac08684-f5, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeac08684-f5, col_values=(('qos', UUID('9c9352ab-2c72-4f0c-bd5c-e8b4b95c8a5f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeac08684-f5, col_values=(('external_ids', {'iface-id': 'eac08684-f54c-4430-898e-099dcd15a69d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:2b:4a', 'vm-uuid': 'fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:11 user nova-compute[75305]: INFO os_vif [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:2b:4a,bridge_name='br-int',has_traffic_filtering=True,id=eac08684-f54c-4430-898e-099dcd15a69d,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac08684-f5')
Nov 14 08:11:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] No VIF found with MAC fa:16:3e:95:2b:4a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:11:11 user nova-compute[75305]: INFO nova.compute.manager [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Detaching volume 57d5a02e-0d68-452c-8d13-6ffeb3976185
Nov 14 08:11:11 user nova-compute[75305]: INFO nova.virt.block_device [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Attempting to driver detach volume 57d5a02e-0d68-452c-8d13-6ffeb3976185 from mountpoint /dev/vdb
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Attempting to detach device vdb from instance 10780135-d628-4567-9825-91df6d78dd22 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:11:11 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:11:11 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:11:11 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:11:11 user nova-compute[75305]:   <serial>57d5a02e-0d68-452c-8d13-6ffeb3976185</serial>
Nov 14 08:11:11 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:11:11 user nova-compute[75305]: </disk>
Nov 14 08:11:11 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:11:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully detached device vdb from instance 10780135-d628-4567-9825-91df6d78dd22 from the persistent domain config.
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 10780135-d628-4567-9825-91df6d78dd22 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:11:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:11:11 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:11:11 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:11:11 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:11:11 user nova-compute[75305]:   <serial>57d5a02e-0d68-452c-8d13-6ffeb3976185</serial>
Nov 14 08:11:11 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:11:11 user nova-compute[75305]: </disk>
Nov 14 08:11:11 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Updated VIF entry in instance network info cache for port eac08684-f54c-4430-898e-099dcd15a69d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Updating instance_info_cache with network_info: [{"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ec33d214-4826-4876-9fca-756b1f71e40e req-61e978f5-ca1c-4167-a9b4-59a5c98a3131 service nova] Releasing lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing instance network info cache due to event network-changed-9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Refreshing network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updated VIF entry in instance network info cache for port 9275f27d-45d9-4ee4-8756-8f0685060d91. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG nova.network.neutron [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-234f4080-4378-4c61-b7bd-72bfb9ba5308 req-a7c7ba3b-b78a-45b1-a1e8-f3d1861b089a service nova] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-d385edb1-8948-423f-8945-653714d23971 req-fa9bd66e-6122-4fcd-8c5d-1544f09d6579 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d385edb1-8948-423f-8945-653714d23971 req-fa9bd66e-6122-4fcd-8c5d-1544f09d6579 service nova] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d385edb1-8948-423f-8945-653714d23971 req-fa9bd66e-6122-4fcd-8c5d-1544f09d6579 service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d385edb1-8948-423f-8945-653714d23971 req-fa9bd66e-6122-4fcd-8c5d-1544f09d6579 service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-d385edb1-8948-423f-8945-653714d23971 req-fa9bd66e-6122-4fcd-8c5d-1544f09d6579 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] No waiting events found dispatching network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:11:13 user nova-compute[75305]: WARNING nova.compute.manager [req-d385edb1-8948-423f-8945-653714d23971 req-fa9bd66e-6122-4fcd-8c5d-1544f09d6579 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received unexpected event network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d for instance with vm_state building and task_state spawning.
Nov 14 08:11:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b495d719-82f6-48e8-9536-656d2f5513d3 is timed out.
Nov 14 08:11:14 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully detached device vdb from instance b495d719-82f6-48e8-9536-656d2f5513d3 from the live domain config.
Nov 14 08:11:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OhFImvSE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:11:14 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[335e2992-265e-438a-b2d9-9382fbfea1d4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:11:14 user nova-compute[75305]: No targets found.
Nov 14 08:11:14 user nova-compute[75305]: iSNS:
Nov 14 08:11:14 user nova-compute[75305]: No targets found.
Nov 14 08:11:14 user nova-compute[75305]: STATIC:
Nov 14 08:11:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1
Nov 14 08:11:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185
Nov 14 08:11:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808
Nov 14 08:11:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:11:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:11:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:14 user nova-compute[75305]: FIRMWARE:
Nov 14 08:11:14 user nova-compute[75305]: No targets found.
Nov 14 08:11:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:11:14 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:11:14 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[125176b5-4d76-49a3-9a0a-611ffc6ebd62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[465bcd21-fcad-4182-9d8e-e32f00fe30a5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 (non-flash)
Nov 14 08:11:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542a9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1'): ({'sdg'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Removing single pathed devices sdg {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a4c20b-ffd8-4d7f-9e4d-6ac29ed370cf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[412f747b-bdeb-4d32-ba13-80e51edf3790]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flushing IO for device /dev/sdg {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93adb327-1cf7-46c5-b816-196b7886fb4a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45abc96-ee1d-4ca6-bea2-77bcafad5b01]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] SCSI volumes sdg have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0869a0b4-f540-4be5-ab4d-e692a54c1a42]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1327ce0d-c169-4eda-a214-991bf1bb6dc3]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260]
Nov 14 08:11:14 user nova-compute[75305]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1, portal: 172.16.0.220,3260] successful.
Nov 14 08:11:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c799ce22-1a94-4cc3-adce-1d19b4dd05e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa4c92f-82c5-48b1-964f-0e332bac4cd1]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== disconnect_volume: return (317ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:11:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid b495d719-82f6-48e8-9536-656d2f5513d3 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e043fadc-00b4-42f9-8bc3-61f087f36c29 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.984s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:11:15 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Instance spawned successfully.
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:11:15 user nova-compute[75305]: INFO nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-b49c4709-50fe-4c39-bc32-1a303c7224fa req-12d85d7d-357a-4abc-a78b-954682fe95ac service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b49c4709-50fe-4c39-bc32-1a303c7224fa req-12d85d7d-357a-4abc-a78b-954682fe95ac service nova] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b49c4709-50fe-4c39-bc32-1a303c7224fa req-12d85d7d-357a-4abc-a78b-954682fe95ac service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b49c4709-50fe-4c39-bc32-1a303c7224fa req-12d85d7d-357a-4abc-a78b-954682fe95ac service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-b49c4709-50fe-4c39-bc32-1a303c7224fa req-12d85d7d-357a-4abc-a78b-954682fe95ac service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] No waiting events found dispatching network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:11:15 user nova-compute[75305]: WARNING nova.compute.manager [req-b49c4709-50fe-4c39-bc32-1a303c7224fa req-12d85d7d-357a-4abc-a78b-954682fe95ac service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received unexpected event network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d for instance with vm_state building and task_state spawning.
Nov 14 08:11:15 user nova-compute[75305]: INFO nova.compute.manager [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Took 6.93 seconds to build instance.
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7e38e9a7-2ff1-4798-9f8f-7bae44a4b3c1 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.032s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e is timed out.
Nov 14 08:11:15 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully detached device vdb from instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e from the live domain config.
Nov 14 08:11:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJqNFgwG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:11:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb5ebd8-7172-4434-89fe-3c6e83783d68]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:11:15 user nova-compute[75305]: No targets found.
Nov 14 08:11:15 user nova-compute[75305]: iSNS:
Nov 14 08:11:15 user nova-compute[75305]: No targets found.
Nov 14 08:11:15 user nova-compute[75305]: STATIC:
Nov 14 08:11:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185
Nov 14 08:11:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808
Nov 14 08:11:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:11:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16
Nov 14 08:11:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:15 user nova-compute[75305]: FIRMWARE:
Nov 14 08:11:15 user nova-compute[75305]: No targets found.
Nov 14 08:11:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:11:15 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:11:15 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc285140-1135-4ae8-abf8-d31bd248c23d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[beda116d-49df-47ba-ac89-70092b9c5055]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:11:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442a9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68689fbf-93c5-4111-9eaf-21293c275ff9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9be06f-2cb2-4d70-9d68-16c26d4327ae]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d9e527-c290-4337-a12c-4b3539ad678e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:11:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df063bf-090a-44c0-aeff-70522638ae2a]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51ebc74-9265-48be-9d65-c43dcd936ab4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fcb641-019a-4d28-88ee-5d395ea7161f]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260]
Nov 14 08:11:16 user nova-compute[75305]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16, portal: 172.16.0.220,3260] successful.
Nov 14 08:11:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6570597-882f-4c7c-8d5d-b12f8552ad16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a51717-025d-4f14-9432-5f9345a82295]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== disconnect_volume: return (347ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'flavor' on Instance uuid 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:11:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a714a442-1b41-4a49-8ec9-07d5243993b5 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.768s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:11:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:23 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:11:23 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.166183471679688GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 10780135-d628-4567-9825-91df6d78dd22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance b495d719-82f6-48e8-9536-656d2f5513d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance dafc732a-81ec-412e-b237-1b18bd6cb577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance c837ffe0-c080-444e-a327-a7781f6d49bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 3c079358-a5f6-4294-84e9-df23abb78b90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:11:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:11:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:11:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 10780135-d628-4567-9825-91df6d78dd22] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [{"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-10780135-d628-4567-9825-91df6d78dd22" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:11:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:32 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 10780135-d628-4567-9825-91df6d78dd22 is timed out.
Nov 14 08:11:32 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully detached device vdb from instance 10780135-d628-4567-9825-91df6d78dd22 from the live domain config.
Nov 14 08:11:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TEibpNgr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:11:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dcec4e-2d49-47d5-9e88-6a57c76f4962]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:11:32 user nova-compute[75305]: No targets found.
Nov 14 08:11:32 user nova-compute[75305]: iSNS:
Nov 14 08:11:32 user nova-compute[75305]: No targets found.
Nov 14 08:11:32 user nova-compute[75305]: STATIC:
Nov 14 08:11:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185
Nov 14 08:11:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808
Nov 14 08:11:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:11:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:11:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:11:32 user nova-compute[75305]: FIRMWARE:
Nov 14 08:11:32 user nova-compute[75305]: No targets found.
Nov 14 08:11:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:11:32 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:11:32 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18acc181-bae2-4576-81af-ce31fddcafd7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[335a8cf0-330e-4fae-8f1e-2035e5d8f2b5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:11:32 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:11:32 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:11:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 (non-flash)
Nov 14 08:11:32 user nova-compute[75305]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:11:32 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:11:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442e6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3387ace2-24aa-4074-8406-12b7f58ed6af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1e2495-a196-42e2-aaac-85a968d41460]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1526e16d-907d-4639-b0dd-20ecf64b3a99]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11104351-958f-4210-83fb-2c147e754a5e]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7add44bc-d08c-4de3-ab11-15d014b83271]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[508ce485-3e5c-4ac0-93d0-b0f106b11efe]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260]
Nov 14 08:11:32 user nova-compute[75305]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185, portal: 172.16.0.220,3260] successful.
Nov 14 08:11:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57d5a02e-0d68-452c-8d13-6ffeb3976185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8383e2a-d34c-4d45-a40f-7f6a277a7625]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== disconnect_volume: return (338ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:11:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:11:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'flavor' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:11:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5aeb7f01-4d4e-47a1-b841-b7bc917fb3c8 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.739s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:43 user nova-compute[75305]: INFO nova.compute.manager [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Terminating instance
Nov 14 08:11:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-fda17d80-b97e-4809-b564-6cde056f2fb0 req-48404dc9-53a3-4e55-b146-c51155d2292b service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-vif-unplugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fda17d80-b97e-4809-b564-6cde056f2fb0 req-48404dc9-53a3-4e55-b146-c51155d2292b service nova] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fda17d80-b97e-4809-b564-6cde056f2fb0 req-48404dc9-53a3-4e55-b146-c51155d2292b service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fda17d80-b97e-4809-b564-6cde056f2fb0 req-48404dc9-53a3-4e55-b146-c51155d2292b service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-fda17d80-b97e-4809-b564-6cde056f2fb0 req-48404dc9-53a3-4e55-b146-c51155d2292b service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] No waiting events found dispatching network-vif-unplugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-fda17d80-b97e-4809-b564-6cde056f2fb0 req-48404dc9-53a3-4e55-b146-c51155d2292b service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-vif-unplugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Instance destroyed successfully.
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'resources' on Instance uuid b495d719-82f6-48e8-9536-656d2f5513d3 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1832998008',display_name='tempest-AttachVolumeNegativeTest-server-1832998008',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1832998008',id=22,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiXjspqqcejR3vk1n0Sc/DQDcrucBgqqBg1qdM2Lva/uaW/DwbsyOZ1ppHXdihHMhqYQHFL2b0yofaE+omoM1VE7c3LT2AO/rvtH2s8/qTZyANZ2KDI5AL56Dd/Z7gd6A==',key_name='tempest-keypair-1751268248',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-4n8bl1pk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:09:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=b495d719-82f6-48e8-9536-656d2f5513d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "address": "fa:16:3e:de:98:5e", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c72ad8f-dd", "ovs_interfaceid": "3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c72ad8f-dd') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG os_vif [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c72ad8f-dd') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c72ad8f-dd, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7599768d-3e01-4628-aa09-900e55807d3f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:44 user nova-compute[75305]: INFO os_vif [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:98:5e,bridge_name='br-int',has_traffic_filtering=True,id=3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c72ad8f-dd')
Nov 14 08:11:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Deleting instance files /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3_del
Nov 14 08:11:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Deletion of /opt/stack/data/nova/instances/b495d719-82f6-48e8-9536-656d2f5513d3_del complete
Nov 14 08:11:44 user nova-compute[75305]: INFO nova.compute.manager [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 08:11:44 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:11:44 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:45 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Took 0.78 seconds to deallocate network for instance.
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:45 user nova-compute[75305]: INFO nova.compute.manager [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Terminating instance
Nov 14 08:11:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:45 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Deleted allocations for instance b495d719-82f6-48e8-9536-656d2f5513d3
Nov 14 08:11:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-893acba7-102e-445e-9748-8e5a2ea3e247 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "b495d719-82f6-48e8-9536-656d2f5513d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Instance destroyed successfully.
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'resources' on Instance uuid 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-282595868',display_name='tempest-ServerActionsTestOtherA-server-102191055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-282595868',id=15,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATQaebgY6FVuDzfByi4n+NZkAFhSWDDR3cOgUOfYqPhuzhPRZQAh2rqky1pom02R6jbd5n7JWx9caNElsIemhUwnvUJsbZN0JtdgFrUe+kcbMjv4SOyBmEz18HgXewRhg==',key_name='tempest-keypair-1756979960',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:08:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-jrdab4sl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:08:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=1a8e1fa0-e30d-4940-b08d-15cfe8b1737e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "2cca97fb-fc47-47b5-a480-2082f53a52db", "address": "fa:16:3e:b4:e9:01", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cca97fb-fc", "ovs_interfaceid": "2cca97fb-fc47-47b5-a480-2082f53a52db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG os_vif [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cca97fb-fc, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf8b9c24-5608-465e-80aa-4ab32c7ed54c) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Acquiring lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Lock "b495d719-82f6-48e8-9536-656d2f5513d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] No waiting events found dispatching network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:11:46 user nova-compute[75305]: WARNING nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received unexpected event network-vif-plugged-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd for instance with vm_state deleted and task_state None.
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: b495d719-82f6-48e8-9536-656d2f5513d3] Received event network-vif-deleted-3c72ad8f-ddbe-4d6b-a933-f3da0b3af3fd {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-unplugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-unplugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-unplugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Acquiring lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] No waiting events found dispatching network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:11:46 user nova-compute[75305]: WARNING nova.compute.manager [req-009d2710-3d85-4cbb-a2a6-246ceeb0e303 req-6b0cad0f-f17c-40c5-8228-6c4141fafc29 service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received unexpected event network-vif-plugged-2cca97fb-fc47-47b5-a480-2082f53a52db for instance with vm_state active and task_state deleting.
Nov 14 08:11:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:11:46 user nova-compute[75305]: INFO os_vif [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:e9:01,bridge_name='br-int',has_traffic_filtering=True,id=2cca97fb-fc47-47b5-a480-2082f53a52db,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cca97fb-fc')
Nov 14 08:11:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Deleting instance files /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e_del
Nov 14 08:11:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Deletion of /opt/stack/data/nova/instances/1a8e1fa0-e30d-4940-b08d-15cfe8b1737e_del complete
Nov 14 08:11:46 user nova-compute[75305]: INFO nova.compute.manager [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 14 08:11:46 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:11:46 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:11:47 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:47 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Took 0.71 seconds to deallocate network for instance.
Nov 14 08:11:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:47 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:11:47 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:11:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:47 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Deleted allocations for instance 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e
Nov 14 08:11:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10d7c58-2157-44a2-a7c6-592dc40ab1c6 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "1a8e1fa0-e30d-4940-b08d-15cfe8b1737e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-2e134ff5-8441-4866-8a47-51617ac1870d req-80cd4071-73d4-4993-abac-db39ddea4b3c service nova] [instance: 1a8e1fa0-e30d-4940-b08d-15cfe8b1737e] Received event network-vif-deleted-2cca97fb-fc47-47b5-a480-2082f53a52db {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-changed-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:11:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Refreshing instance network info cache due to event network-changed-6ffb3807-5d0f-4854-8636-f11f27f02f08. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:11:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] Acquiring lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:11:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] Acquired lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:11:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Refreshing network info cache for port 6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:11:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG nova.network.neutron [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updated VIF entry in instance network info cache for port 6ffb3807-5d0f-4854-8636-f11f27f02f08. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG nova.network.neutron [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updating instance_info_cache with network_info: [{"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fc5b0a04-52aa-4aa1-935c-9b436f5af440 req-c594e559-fe4e-4fe9-a2f9-88ef16837574 service nova] Releasing lock "refresh_cache-dafc732a-81ec-412e-b237-1b18bd6cb577" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'flavor' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:11:57 user nova-compute[75305]: INFO nova.compute.manager [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Attaching volume 7afa7c06-99ee-43b3-8390-b3f70a102bc2 to /dev/vdb
Nov 14 08:11:57 user nova-compute[75305]: DEBUG os_brick.utils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b82d63-6109-4a23-b041-2777e7726305]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bd4b7b-9e82-464b-94de-9f5d66eb1d4f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a924ca5-d949-422e-a95a-d79d66373d6b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b214c-84f9-40ce-9848-b527749a87e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:11:57 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:11:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16303a8b-65f7-488d-88b6-288f8469cb4a]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG os_brick.utils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:11:57 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updating existing volume attachment record: 9d8c516a-7388-4082-9235-7d9739e8bdf2 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:11:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:11:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:01 user nova-compute[75305]: INFO nova.compute.manager [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Rescuing
Nov 14 08:12:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:12:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:12:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:12:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:12:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-a028a792-9926-411e-98ad-7b120a546ce7 req-e7b01f22-90b8-4737-82b7-1449f73a9c32 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a028a792-9926-411e-98ad-7b120a546ce7 req-e7b01f22-90b8-4737-82b7-1449f73a9c32 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a028a792-9926-411e-98ad-7b120a546ce7 req-e7b01f22-90b8-4737-82b7-1449f73a9c32 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a028a792-9926-411e-98ad-7b120a546ce7 req-e7b01f22-90b8-4737-82b7-1449f73a9c32 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-a028a792-9926-411e-98ad-7b120a546ce7 req-e7b01f22-90b8-4737-82b7-1449f73a9c32 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:02 user nova-compute[75305]: WARNING nova.compute.manager [req-a028a792-9926-411e-98ad-7b120a546ce7 req-e7b01f22-90b8-4737-82b7-1449f73a9c32 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state active and task_state rescuing.
Nov 14 08:12:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnefDVpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:02 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:02 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:02 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece6afc-eb60-456e-8a17-11e5353c4f88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:12:02 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe57176-924d-42ca-9214-0448a0127ff9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2] added
Nov 14 08:12:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance destroyed successfully.
Nov 14 08:12:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Attempting a stable device rescue
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2178b61-f681-4459-a102-45211af199bb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.121s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f947473c-c642-44e1-bdf2-74f1f3b53492]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:12:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Creating image(s)
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.027s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'trusted_certs' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SnefDVpA {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SnefDVpA" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[597c4e9b-e87f-4e2e-ac1c-33a845b7a3e0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SnefDVpA'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "27b61cca05f8617752fc4396e41b23b8277660c9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "27b61cca05f8617752fc4396e41b23b8277660c9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[577bade8-027f-42b9-aaf4-337927e43c54]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c58f763-3581-4046-83dd-e3a555112b0c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:02 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:02 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3e025c-11d2-4e99-803e-430643dc57ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260]
Nov 14 08:12:03 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260] successful.
Nov 14 08:12:03 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a703a-31bc-41a1-993f-3a95505061ae]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8a84ef-3cc6-477d-a6ed-95d96bd26ee9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:04 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:04 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:04 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:04 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.471s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[856fc098-cd6d-483a-bc3c-27d0498ce539]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnefDVpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.part --force-share --output=json" returned: 0 in 0.215s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG nova.virt.images [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] eaa49099-f574-4b83-8c60-565fff085a32 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.part /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-6276e43c-e098-41d0-9b8c-db3c44990ddb req-192764b9-3484-4340-8caa-d550b5304c8b service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6276e43c-e098-41d0-9b8c-db3c44990ddb req-192764b9-3484-4340-8caa-d550b5304c8b service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6276e43c-e098-41d0-9b8c-db3c44990ddb req-192764b9-3484-4340-8caa-d550b5304c8b service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6276e43c-e098-41d0-9b8c-db3c44990ddb req-192764b9-3484-4340-8caa-d550b5304c8b service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-6276e43c-e098-41d0-9b8c-db3c44990ddb req-192764b9-3484-4340-8caa-d550b5304c8b service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:04 user nova-compute[75305]: WARNING nova.compute.manager [req-6276e43c-e098-41d0-9b8c-db3c44990ddb req-192764b9-3484-4340-8caa-d550b5304c8b service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state active and task_state rescuing.
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.part /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.converted" returned: 0 in 0.387s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9.converted --force-share --output=json" returned: 0 in 0.266s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "27b61cca05f8617752fc4396e41b23b8277660c9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.019s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "27b61cca05f8617752fc4396e41b23b8277660c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "27b61cca05f8617752fc4396e41b23b8277660c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:04 user nova-compute[75305]: INFO nova.compute.manager [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Terminating instance
Nov 14 08:12:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:12:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9 --force-share --output=json" returned: 0 in 0.211s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9,backing_fmt=raw /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.532s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] <== connect_volume: return (2536ms) {'type': 'block', 'scsi_wwn': '23532313164346134', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23532313164346134', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9,backing_fmt=raw /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue" returned: 0 in 0.054s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "27b61cca05f8617752fc4396e41b23b8277660c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'migration_context' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'flavor' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<f5e23822-868e-4437-b87b-487179175d6c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Start _get_guest_xml network_info=[{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "vif_mac": "fa:16:3e:38:2f:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eaa49099-f574-4b83-8c60-565fff085a32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'bda938c2-6421-41fc-9582-8d73cd0fdc77', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMNhyYjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f5e23822-868e-4437-b87b-487179175d6c', 'attached_at': '', 'detached_at': '', 'volume_id': '3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'serial': '3a6f6dd4-a311-4876-850d-dcebf1e15f67'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'resources' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:12:05 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:05 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:12:05 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:12:05 user nova-compute[75305]:   <serial>7afa7c06-99ee-43b3-8390-b3f70a102bc2</serial>
Nov 14 08:12:05 user nova-compute[75305]: </disk>
Nov 14 08:12:05 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<f5e23822-868e-4437-b87b-487179175d6c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'numa_topology' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<f5e23822-868e-4437-b87b-487179175d6c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:12:05 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:05 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<f5e23822-868e-4437-b87b-487179175d6c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMNhyYjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:05 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:05 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:05 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0fec616-2c4e-4166-bed0-8ef68e17c21e req-96bee171-f44e-4ba3-9a48-b504ac996622 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fec616-2c4e-4166-bed0-8ef68e17c21e req-96bee171-f44e-4ba3-9a48-b504ac996622 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fec616-2c4e-4166-bed0-8ef68e17c21e req-96bee171-f44e-4ba3-9a48-b504ac996622 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fec616-2c4e-4166-bed0-8ef68e17c21e req-96bee171-f44e-4ba3-9a48-b504ac996622 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0fec616-2c4e-4166-bed0-8ef68e17c21e req-96bee171-f44e-4ba3-9a48-b504ac996622 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0fec616-2c4e-4166-bed0-8ef68e17c21e req-96bee171-f44e-4ba3-9a48-b504ac996622 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04de1ec-6844-4434-be7b-cd1fe855b7c2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QMNhyYjZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 08:12:05 user nova-compute[75305]: node.name = iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:12:05 user nova-compute[75305]: node.tpgt = -1
Nov 14 08:12:05 user nova-compute[75305]: node.startup = automatic
Nov 14 08:12:05 user nova-compute[75305]: node.leading_login = No
Nov 14 08:12:05 user nova-compute[75305]: iface.iscsi_ifacename = default
Nov 14 08:12:05 user nova-compute[75305]: iface.net_ifacename = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.ipaddress = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.prefix_len = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.hwaddress = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.transport_name = tcp
Nov 14 08:12:05 user nova-compute[75305]: iface.initiatorname = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.state = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.vlan_id = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.vlan_priority = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.vlan_state = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.iface_num = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.mtu = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.port = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.bootproto = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.subnet_mask = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.gateway = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_alt_client_id = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_dns = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_learn_iqn = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_vendor_id_state = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_vendor_id = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.dhcp_slp_da = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.fragmentation = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.gratuitous_arp = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.incoming_forwarding = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.tos_state = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.tos = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.ttl = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.delayed_ack = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.tcp_nagle = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.tcp_wsf_state = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.tcp_wsf = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.tcp_timer_scale = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.tcp_timestamp = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.redirect = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.def_task_mgmt_timeout = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.header_digest = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.data_digest = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.immediate_data = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.initial_r2t = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.data_seq_inorder = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.data_pdu_inorder = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.erl = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.max_receive_data_len = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.first_burst_len = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.max_outstanding_r2t = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.max_burst_len = 0
Nov 14 08:12:05 user nova-compute[75305]: iface.chap_auth = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.bidi_chap = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.strict_login_compliance = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.discovery_auth = <empty>
Nov 14 08:12:05 user nova-compute[75305]: iface.discovery_logout = <empty>
Nov 14 08:12:05 user nova-compute[75305]: node.discovery_address = <empty>
Nov 14 08:12:05 user nova-compute[75305]: node.discovery_port = 0
Nov 14 08:12:05 user nova-compute[75305]: node.discovery_type = static
Nov 14 08:12:05 user nova-compute[75305]: node.session.initial_cmdsn = 0
Nov 14 08:12:05 user nova-compute[75305]: node.session.initial_login_retry_max = 8
Nov 14 08:12:05 user nova-compute[75305]: node.session.xmit_thread_priority = -20
Nov 14 08:12:05 user nova-compute[75305]: node.session.cmds_max = 128
Nov 14 08:12:05 user nova-compute[75305]: node.session.queue_depth = 32
Nov 14 08:12:05 user nova-compute[75305]: node.session.nr_sessions = 1
Nov 14 08:12:05 user nova-compute[75305]: node.session.auth.authmethod = CHAP
Nov 14 08:12:05 user nova-compute[75305]: node.session.auth.username = QMNhyYjZ
Nov 14 08:12:05 user nova-compute[75305]: node.session.auth.password = ***
Nov 14 08:12:05 user nova-compute[75305]: node.session.auth.username_in = <empty>
Nov 14 08:12:05 user nova-compute[75305]: node.session.auth.password_in = <empty>
Nov 14 08:12:05 user nova-compute[75305]: node.session.auth.chap_algs = MD5
Nov 14 08:12:05 user nova-compute[75305]: node.session.timeo.replacement_timeout = 120
Nov 14 08:12:05 user nova-compute[75305]: node.session.err_timeo.abort_timeout = 15
Nov 14 08:12:05 user nova-compute[75305]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 08:12:05 user nova-compute[75305]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 08:12:05 user nova-compute[75305]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.FastAbort = Yes
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.InitialR2T = No
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.ImmediateData = Yes
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.MaxConnections = 1
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 08:12:05 user nova-compute[75305]: node.session.iscsi.ERL = 0
Nov 14 08:12:05 user nova-compute[75305]: node.session.scan = manual
Nov 14 08:12:05 user nova-compute[75305]: node.session.reopen_max = 0
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].address = 172.16.0.220
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].port = 3260
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].startup = manual
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].tcp.window_size = 524288
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].tcp.type_of_service = 0
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].timeo.logout_timeout = 15
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].timeo.login_timeout = 15
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].timeo.auth_timeout = 45
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].iscsi.DataDigest = None
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].iscsi.IFMarker = No
Nov 14 08:12:05 user nova-compute[75305]: node.conn[0].iscsi.OFMarker = No
Nov 14 08:12:05 user nova-compute[75305]: # END RECORD
Nov 14 08:12:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeb37d6-5153-404e-81d7-52874da905d9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e37989a-0620-478d-b342-415cd9d2f745]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMNhyYjZ {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMNhyYjZ" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b1429f-81fb-423c-a937-3bdcc66760f6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMNhyYjZ'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19011b50-e057-4d53-8e21-2709a974f475]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f816df-d4db-445b-9a70-249d0a013d26]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:05 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:05 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:05 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:05 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.183s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] HCTL ('36', '0', '0', 0) found on session 28 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2cec2f-7bb9-480a-84b2-91225f4f6246]: (4, ('0 0 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching for a device in session 28 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMNhyYjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.210s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== connect_volume: return (213ms) {'type': 'block', 'scsi_wwn': '23038613231626431', 'path': '/dev/sde'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038613231626431', 'path': '/dev/sde'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1305131567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1305131567',id=24,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:10:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-d068ubjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:10:27Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=f5e23822-868e-4437-b87b-487179175d6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "vif_mac": "fa:16:3e:38:2f:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "vif_mac": "fa:16:3e:38:2f:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'pci_devices' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.objects.base [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<f5e23822-868e-4437-b87b-487179175d6c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:12:05 user nova-compute[75305]:   <uuid>f5e23822-868e-4437-b87b-487179175d6c</uuid>
Nov 14 08:12:05 user nova-compute[75305]:   <name>instance-00000018</name>
Nov 14 08:12:05 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:12:05 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:12:05 user nova-compute[75305]:   <metadata>
Nov 14 08:12:05 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:12:05 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:12:05 user nova-compute[75305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1305131567</nova:name>
Nov 14 08:12:05 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:12:05</nova:creationTime>
Nov 14 08:12:05 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:12:05 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:12:05 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:12:05 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:12:05 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:12:05 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:12:05 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:12:05 user nova-compute[75305]:       <nova:owner>
Nov 14 08:12:05 user nova-compute[75305]:         <nova:user uuid="74b6bdb955524015ad1aec74ee466957">tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member</nova:user>
Nov 14 08:12:05 user nova-compute[75305]:         <nova:project uuid="f92869b8c2e246ca8f9d361c8ecabac0">tempest-ServerBootFromVolumeStableRescueTest-983718269</nova:project>
Nov 14 08:12:05 user nova-compute[75305]:       </nova:owner>
Nov 14 08:12:05 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:12:05 user nova-compute[75305]:       <nova:ports>
Nov 14 08:12:05 user nova-compute[75305]:         <nova:port uuid="205f3177-c6be-4124-b32a-fe905fdb9493">
Nov 14 08:12:05 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:12:05 user nova-compute[75305]:         </nova:port>
Nov 14 08:12:05 user nova-compute[75305]:       </nova:ports>
Nov 14 08:12:05 user nova-compute[75305]:     </nova:instance>
Nov 14 08:12:05 user nova-compute[75305]:   </metadata>
Nov 14 08:12:05 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:12:05 user nova-compute[75305]:     <system>
Nov 14 08:12:05 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:12:05 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:12:05 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:12:05 user nova-compute[75305]:       <entry name="serial">f5e23822-868e-4437-b87b-487179175d6c</entry>
Nov 14 08:12:05 user nova-compute[75305]:       <entry name="uuid">f5e23822-868e-4437-b87b-487179175d6c</entry>
Nov 14 08:12:05 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:12:05 user nova-compute[75305]:     </system>
Nov 14 08:12:05 user nova-compute[75305]:   </sysinfo>
Nov 14 08:12:05 user nova-compute[75305]:   <os>
Nov 14 08:12:05 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:12:05 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:12:05 user nova-compute[75305]:   </os>
Nov 14 08:12:05 user nova-compute[75305]:   <features>
Nov 14 08:12:05 user nova-compute[75305]:     <acpi/>
Nov 14 08:12:05 user nova-compute[75305]:     <apic/>
Nov 14 08:12:05 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:12:05 user nova-compute[75305]:   </features>
Nov 14 08:12:05 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:12:05 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:12:05 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:12:05 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:12:05 user nova-compute[75305]:   </clock>
Nov 14 08:12:05 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:12:05 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:12:05 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:12:05 user nova-compute[75305]:   </cpu>
Nov 14 08:12:05 user nova-compute[75305]:   <devices>
Nov 14 08:12:05 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:12:05 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:05 user nova-compute[75305]:       <source dev="/dev/sde"/>
Nov 14 08:12:05 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:12:05 user nova-compute[75305]:       <serial>3a6f6dd4-a311-4876-850d-dcebf1e15f67</serial>
Nov 14 08:12:05 user nova-compute[75305]:     </disk>
Nov 14 08:12:05 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:12:05 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:12:05 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue"/>
Nov 14 08:12:05 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:12:05 user nova-compute[75305]:       <boot order="1"/>
Nov 14 08:12:05 user nova-compute[75305]:     </disk>
Nov 14 08:12:05 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:12:05 user nova-compute[75305]:       <mac address="fa:16:3e:38:2f:79"/>
Nov 14 08:12:05 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:12:05 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:12:05 user nova-compute[75305]:       <target dev="tap205f3177-c6"/>
Nov 14 08:12:05 user nova-compute[75305]:     </interface>
Nov 14 08:12:05 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:12:05 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/console.log" append="off"/>
Nov 14 08:12:05 user nova-compute[75305]:     </serial>
Nov 14 08:12:05 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:12:05 user nova-compute[75305]:     <video>
Nov 14 08:12:05 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:12:05 user nova-compute[75305]:     </video>
Nov 14 08:12:05 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:12:05 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:12:05 user nova-compute[75305]:     </rng>
Nov 14 08:12:05 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:12:05 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:12:05 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:12:05 user nova-compute[75305]:     </memballoon>
Nov 14 08:12:05 user nova-compute[75305]:   </devices>
Nov 14 08:12:05 user nova-compute[75305]: </domain>
Nov 14 08:12:05 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:12:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance destroyed successfully.
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No VIF found with MAC fa:16:3e:38:2f:79, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] Instance destroyed successfully.
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.objects.instance [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'resources' on Instance uuid 10780135-d628-4567-9825-91df6d78dd22 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1030370936',display_name='tempest-TestMinimumBasicScenario-server-1030370936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1030370936',id=20,image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2RLG9owF1Nc7k0X8tP8zsStohtcewc48Y+CrHnjSnuOkdnHc1S2LIwE7uLd+b7l9fC53B0GI/xmUskFmZD845kIKEB4cJ2YaftNCILebKGzEjZ0424jmXX8dzmF2pI7g==',key_name='tempest-TestMinimumBasicScenario-484244990',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-oj8ex2zh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b765263c-c7b9-4d71-ad2e-0a1cab07f385',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:09:26Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=10780135-d628-4567-9825-91df6d78dd22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "9275f27d-45d9-4ee4-8756-8f0685060d91", "address": "fa:16:3e:8f:2f:04", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9275f27d-45", "ovs_interfaceid": "9275f27d-45d9-4ee4-8756-8f0685060d91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG os_vif [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9275f27d-45, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f47ca980-a8a6-41ce-ab14-0150a6adaec5) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: INFO os_vif [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:2f:04,bridge_name='br-int',has_traffic_filtering=True,id=9275f27d-45d9-4ee4-8756-8f0685060d91,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9275f27d-45')
Nov 14 08:12:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Deleting instance files /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22_del
Nov 14 08:12:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Deletion of /opt/stack/data/nova/instances/10780135-d628-4567-9825-91df6d78dd22_del complete
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No VIF found with MAC fa:16:3e:13:9c:4a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:12:06 user nova-compute[75305]: INFO nova.compute.manager [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: 10780135-d628-4567-9825-91df6d78dd22] Took 1.53 seconds to destroy the instance on the hypervisor.
Nov 14 08:12:06 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-71505887-ccf2-4390-9ec0-9555e4ee0cd0 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.934s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:06 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 10780135-d628-4567-9825-91df6d78dd22] Took 0.50 seconds to deallocate network for instance.
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-62d23449-fc5c-4979-a5f0-100481032290 req-ffaf43d4-df56-43db-96ba-909e201dc774 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-deleted-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:06 user nova-compute[75305]: INFO nova.compute.manager [req-62d23449-fc5c-4979-a5f0-100481032290 req-ffaf43d4-df56-43db-96ba-909e201dc774 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Neutron deleted interface 9275f27d-45d9-4ee4-8756-8f0685060d91; detaching it from the instance and deleting it from the info cache
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.network.neutron [req-62d23449-fc5c-4979-a5f0-100481032290 req-ffaf43d4-df56-43db-96ba-909e201dc774 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-62d23449-fc5c-4979-a5f0-100481032290 req-ffaf43d4-df56-43db-96ba-909e201dc774 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Detach interface failed, port_id=9275f27d-45d9-4ee4-8756-8f0685060d91, reason: Instance 10780135-d628-4567-9825-91df6d78dd22 could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:07 user nova-compute[75305]: WARNING nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state deleted and task_state None.
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:07 user nova-compute[75305]: WARNING nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state deleted and task_state None.
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:07 user nova-compute[75305]: WARNING nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state deleted and task_state None.
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:07 user nova-compute[75305]: WARNING nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-unplugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state deleted and task_state None.
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Acquiring lock "10780135-d628-4567-9825-91df6d78dd22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] Lock "10780135-d628-4567-9825-91df6d78dd22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] No waiting events found dispatching network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:07 user nova-compute[75305]: WARNING nova.compute.manager [req-7239a3a1-1748-41b7-abc6-9c666defff6a req-b588ea68-48bf-4e9d-80ad-0c141e768dc7 service nova] [instance: 10780135-d628-4567-9825-91df6d78dd22] Received unexpected event network-vif-plugged-9275f27d-45d9-4ee4-8756-8f0685060d91 for instance with vm_state deleted and task_state None.
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:07 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Deleted allocations for instance 10780135-d628-4567-9825-91df6d78dd22
Nov 14 08:12:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-82f9830b-94d7-4581-8cbc-eedb6d932156 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "10780135-d628-4567-9825-91df6d78dd22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.635s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:12:08 user nova-compute[75305]: INFO nova.compute.claims [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Claim successful on node user
Nov 14 08:12:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.network.neutron [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:12:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.policy [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '192f4325fbea478aadbf131b02bf891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e24af031694052bb3ea06040959499', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:12:08 user nova-compute[75305]: INFO nova.virt.block_device [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Booting with volume 0534c23b-a785-482a-843d-659c7093bb4a at /dev/vda
Nov 14 08:12:08 user nova-compute[75305]: DEBUG os_brick.utils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff34f06d-dc93-4bac-b118-b80e808a7659]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:08 user nova-compute[75305]: WARNING nova.compute.manager [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state active and task_state rescuing.
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:08 user nova-compute[75305]: WARNING nova.compute.manager [req-e0fba524-65a6-4352-a72f-7967399eb259 req-9b5c5982-3a4c-40fc-b485-b4b9d22bcde9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state active and task_state rescuing.
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adfa1ea-e617-48e1-8c41-936659432d5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3bfc2-a7f3-4baa-ae96-a896604f9109]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a5a61c-819e-4a7d-9061-7a38d2197fdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:12:09 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:12:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4859e9da-a963-4b65-9bdb-b06d0deacada]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG os_brick.utils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updating existing volume attachment record: 51f4b2fc-421b-4cd4-a76c-6e6a829a8d42 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Successfully created port: f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:12:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cbe8b4da-fd18-4067-b281-f0097eda3191 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Successfully updated port: f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquired lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG nova.network.neutron [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updating instance_info_cache with network_info: [{"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Releasing lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:12:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance network_info: |[{"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-changed-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Refreshing instance network info cache due to event network-changed-f93212f5-8c61-4e7b-9041-ebfa201aaaa2. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] Acquiring lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] Acquired lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Refreshing network info cache for port f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'flavor' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:11 user nova-compute[75305]: INFO nova.compute.manager [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Attaching volume 6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 to /dev/vdc
Nov 14 08:12:11 user nova-compute[75305]: DEBUG os_brick.utils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77318a99-7e0d-4372-b00c-f2a8a28b158d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb32b32-d815-49a5-872a-f7cd44317360]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f83c24b-0bbe-4ae6-abdf-0e1657599540]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bac4fa4-d64f-408f-afe0-ba7e6b6785db]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updated VIF entry in instance network info cache for port f93212f5-8c61-4e7b-9041-ebfa201aaaa2. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG nova.network.neutron [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updating instance_info_cache with network_info: [{"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:12:11 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e44721-086a-4070-a312-c91d5d10cdc8]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG os_brick.utils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updating existing volume attachment record: f8b5c94a-ccad-41da-aa97-3ad6a0d5531b {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b393e5ef-5a2d-4c42-b356-af512fa8e15e req-454e9497-ddef-4432-82cc-c4ab90bdb5f0 service nova] Releasing lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:12:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:12:14 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Creating image(s)
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Ensure instance console log exists: /opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Start _get_guest_xml network_info=[{"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '51f4b2fc-421b-4cd4-a76c-6e6a829a8d42', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba827b89-5258-4f7e-9e5d-eb13f35affd4', 'attached_at': '', 'detached_at': '', 'volume_id': '0534c23b-a785-482a-843d-659c7093bb4a', 'serial': '0534c23b-a785-482a-843d-659c7093bb4a'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:12:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:14 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:14 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:14 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c5ad8d-8f3c-4900-80a5-fa6ea4071289]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:12:14 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ee7ce4-228f-4b76-9fa1-54a5a75fdf82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a] added
Nov 14 08:12:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2389ca-2866-4170-b756-12b2ea5694c8]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e23ebb-a2a6-4968-a5a0-178faca6d1a0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fcbVKIjm {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fcbVKIjm" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e307f-e7ab-4bd6-80ae-66066725fbb2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fcbVKIjm'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5850bf9e-1a82-4c43-bd5a-133f44886a11]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9793340-3f24-4bcc-a2c2-8bacbf343ddc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74b5af6-25a4-46b9-879e-8c34d5cf5ecf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]
Nov 14 08:12:14 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.
Nov 14 08:12:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7eed66-3a9d-4391-b9d6-78fe291a0065]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e76f3-805a-4866-aabc-4439e53b18ae]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:14 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d643d53d-f4c3-4de1-af21-c13d6a4f4922]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:12:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26265303638613766', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265303638613766', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1517392847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517392847',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSHuOBu4lWTlW7Vctn1xXnnT45BYbFZ8zeCXHYrkzYMRxRFA3Nz9SmGzjNbbgTlWci9ACTz2z5/PYwN7XHX+Hj6DF4ifeWa+fwkxv/lSrOPQjwXf0hJfz0Ul+A3SAl5Dw==',key_name='tempest-keypair-61336421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31e24af031694052bb3ea06040959499',ramdisk_id='',reservation_id='r-gam6gp6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-196740715',owner_user_name='tempest-ServerActionsV293TestJSON-196740715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='192f4325fbea478aadbf131b02bf891e',uuid=ba827b89-5258-4f7e-9e5d-eb13f35affd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converting VIF {"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lazy-loading 'pci_devices' on Instance uuid ba827b89-5258-4f7e-9e5d-eb13f35affd4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:12:15 user nova-compute[75305]:   <uuid>ba827b89-5258-4f7e-9e5d-eb13f35affd4</uuid>
Nov 14 08:12:15 user nova-compute[75305]:   <name>instance-0000001b</name>
Nov 14 08:12:15 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:12:15 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:12:15 user nova-compute[75305]:   <metadata>
Nov 14 08:12:15 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:12:15 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:12:15 user nova-compute[75305]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1517392847</nova:name>
Nov 14 08:12:15 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:12:14</nova:creationTime>
Nov 14 08:12:15 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:12:15 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:12:15 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:12:15 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:12:15 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:12:15 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:12:15 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:12:15 user nova-compute[75305]:       <nova:owner>
Nov 14 08:12:15 user nova-compute[75305]:         <nova:user uuid="192f4325fbea478aadbf131b02bf891e">tempest-ServerActionsV293TestJSON-196740715-project-member</nova:user>
Nov 14 08:12:15 user nova-compute[75305]:         <nova:project uuid="31e24af031694052bb3ea06040959499">tempest-ServerActionsV293TestJSON-196740715</nova:project>
Nov 14 08:12:15 user nova-compute[75305]:       </nova:owner>
Nov 14 08:12:15 user nova-compute[75305]:       <nova:ports>
Nov 14 08:12:15 user nova-compute[75305]:         <nova:port uuid="f93212f5-8c61-4e7b-9041-ebfa201aaaa2">
Nov 14 08:12:15 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 08:12:15 user nova-compute[75305]:         </nova:port>
Nov 14 08:12:15 user nova-compute[75305]:       </nova:ports>
Nov 14 08:12:15 user nova-compute[75305]:     </nova:instance>
Nov 14 08:12:15 user nova-compute[75305]:   </metadata>
Nov 14 08:12:15 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:12:15 user nova-compute[75305]:     <system>
Nov 14 08:12:15 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:12:15 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:12:15 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:12:15 user nova-compute[75305]:       <entry name="serial">ba827b89-5258-4f7e-9e5d-eb13f35affd4</entry>
Nov 14 08:12:15 user nova-compute[75305]:       <entry name="uuid">ba827b89-5258-4f7e-9e5d-eb13f35affd4</entry>
Nov 14 08:12:15 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:12:15 user nova-compute[75305]:     </system>
Nov 14 08:12:15 user nova-compute[75305]:   </sysinfo>
Nov 14 08:12:15 user nova-compute[75305]:   <os>
Nov 14 08:12:15 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:12:15 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:12:15 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:12:15 user nova-compute[75305]:   </os>
Nov 14 08:12:15 user nova-compute[75305]:   <features>
Nov 14 08:12:15 user nova-compute[75305]:     <acpi/>
Nov 14 08:12:15 user nova-compute[75305]:     <apic/>
Nov 14 08:12:15 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:12:15 user nova-compute[75305]:   </features>
Nov 14 08:12:15 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:12:15 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:12:15 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:12:15 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:12:15 user nova-compute[75305]:   </clock>
Nov 14 08:12:15 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:12:15 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:12:15 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:12:15 user nova-compute[75305]:   </cpu>
Nov 14 08:12:15 user nova-compute[75305]:   <devices>
Nov 14 08:12:15 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:12:15 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:15 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:12:15 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:12:15 user nova-compute[75305]:       <serial>0534c23b-a785-482a-843d-659c7093bb4a</serial>
Nov 14 08:12:15 user nova-compute[75305]:     </disk>
Nov 14 08:12:15 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:12:15 user nova-compute[75305]:       <mac address="fa:16:3e:6a:5d:bd"/>
Nov 14 08:12:15 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:12:15 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:12:15 user nova-compute[75305]:       <target dev="tapf93212f5-8c"/>
Nov 14 08:12:15 user nova-compute[75305]:     </interface>
Nov 14 08:12:15 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:12:15 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4/console.log" append="off"/>
Nov 14 08:12:15 user nova-compute[75305]:     </serial>
Nov 14 08:12:15 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:12:15 user nova-compute[75305]:     <video>
Nov 14 08:12:15 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:12:15 user nova-compute[75305]:     </video>
Nov 14 08:12:15 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:12:15 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:12:15 user nova-compute[75305]:     </rng>
Nov 14 08:12:15 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:12:15 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:12:15 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:12:15 user nova-compute[75305]:     </memballoon>
Nov 14 08:12:15 user nova-compute[75305]:   </devices>
Nov 14 08:12:15 user nova-compute[75305]: </domain>
Nov 14 08:12:15 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1517392847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517392847',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSHuOBu4lWTlW7Vctn1xXnnT45BYbFZ8zeCXHYrkzYMRxRFA3Nz9SmGzjNbbgTlWci9ACTz2z5/PYwN7XHX+Hj6DF4ifeWa+fwkxv/lSrOPQjwXf0hJfz0Ul+A3SAl5Dw==',key_name='tempest-keypair-61336421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31e24af031694052bb3ea06040959499',ramdisk_id='',reservation_id='r-gam6gp6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-196740715',owner_user_name='tempest-ServerActionsV293TestJSON-196740715-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='192f4325fbea478aadbf131b02bf891e',uuid=ba827b89-5258-4f7e-9e5d-eb13f35affd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converting VIF {"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG os_vif [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bb928e7-d34c-5ad0-8879-e9cefa27cfd9', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf93212f5-8c, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf93212f5-8c, col_values=(('qos', UUID('708bd2ec-db10-4b84-a374-7e30d358a975')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf93212f5-8c, col_values=(('external_ids', {'iface-id': 'f93212f5-8c61-4e7b-9041-ebfa201aaaa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:5d:bd', 'vm-uuid': 'ba827b89-5258-4f7e-9e5d-eb13f35affd4'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:15 user nova-compute[75305]: INFO os_vif [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c')
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] No VIF found with MAC fa:16:3e:6a:5d:bd, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRaXlqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:16 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bdd573-cb4f-4a65-85ce-91abde203b3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:12:16 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde0a2e3-08fc-4ff7-8958-ca3404ca84f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5] added
Nov 14 08:12:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b794d9-e3b2-49d2-9520-3664f3dcddab]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8485ed28-c9c4-4a90-a59c-6ecd80e2ec81]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdRaXlqA {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdRaXlqA" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86316397-3eda-40ef-aae1-d80d423ccc0c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DdRaXlqA'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd9b66b-6234-4336-b073-2d3f76ac22c4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b202f3f2-9115-4a78-a8c5-5841668ee66e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3354e85-e6c8-4b2a-8abb-6784294b9dac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260]
Nov 14 08:12:16 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260] successful.
Nov 14 08:12:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b747bc0f-7593-42a3-a7b3-bf34de19c037]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e87b25a-08ce-47d9-92e0-a82842c6c2a0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:16 user nova-compute[75305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)
Nov 14 08:12:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f454e53b-35ac-499b-ad90-cb45ee05d69b]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRaXlqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:16 user nova-compute[75305]: INFO nova.compute.manager [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Detaching volume 2afada73-2627-4b1a-a097-bac0bcf3c808
Nov 14 08:12:16 user nova-compute[75305]: INFO nova.virt.block_device [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Attempting to driver detach volume 2afada73-2627-4b1a-a097-bac0bcf3c808 from mountpoint /dev/vdc
Nov 14 08:12:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Attempting to detach device vdc from instance c837ffe0-c080-444e-a327-a7781f6d49bc from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:12:16 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:16 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:12:16 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:12:16 user nova-compute[75305]:   <serial>2afada73-2627-4b1a-a097-bac0bcf3c808</serial>
Nov 14 08:12:16 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:12:16 user nova-compute[75305]: </disk>
Nov 14 08:12:16 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:12:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully detached device vdc from instance c837ffe0-c080-444e-a327-a7781f6d49bc from the persistent domain config.
Nov 14 08:12:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c837ffe0-c080-444e-a327-a7781f6d49bc from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:12:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:12:16 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:16 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:12:16 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:12:16 user nova-compute[75305]:   <serial>2afada73-2627-4b1a-a097-bac0bcf3c808</serial>
Nov 14 08:12:16 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:12:16 user nova-compute[75305]: </disk>
Nov 14 08:12:16 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-f9b6f249-7e5f-4e01-a655-1ec10cc5f180 req-4878712c-e657-410a-869d-3835c565bde7 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f9b6f249-7e5f-4e01-a655-1ec10cc5f180 req-4878712c-e657-410a-869d-3835c565bde7 service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f9b6f249-7e5f-4e01-a655-1ec10cc5f180 req-4878712c-e657-410a-869d-3835c565bde7 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f9b6f249-7e5f-4e01-a655-1ec10cc5f180 req-4878712c-e657-410a-869d-3835c565bde7 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-f9b6f249-7e5f-4e01-a655-1ec10cc5f180 req-4878712c-e657-410a-869d-3835c565bde7 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:17 user nova-compute[75305]: WARNING nova.compute.manager [req-f9b6f249-7e5f-4e01-a655-1ec10cc5f180 req-4878712c-e657-410a-869d-3835c565bde7 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received unexpected event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with vm_state building and task_state spawning.
Nov 14 08:12:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '26434366236343639', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434366236343639', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'flavor' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:12:17 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:17 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:12:17 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:12:17 user nova-compute[75305]:   <serial>6db2e303-2eec-40b7-9cfe-be0d9d23c6a5</serial>
Nov 14 08:12:17 user nova-compute[75305]: </disk>
Nov 14 08:12:17 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] No VIF found with MAC fa:16:3e:13:9c:4a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:12:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d94a1f76-8fad-4594-87be-ae776ae4bd79 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.153s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-e31333f0-77e3-4166-93da-f57b9d5a8834 req-9907bf0e-3ad9-4d68-909a-581e5272b17a service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31333f0-77e3-4166-93da-f57b9d5a8834 req-9907bf0e-3ad9-4d68-909a-581e5272b17a service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31333f0-77e3-4166-93da-f57b9d5a8834 req-9907bf0e-3ad9-4d68-909a-581e5272b17a service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31333f0-77e3-4166-93da-f57b9d5a8834 req-9907bf0e-3ad9-4d68-909a-581e5272b17a service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-e31333f0-77e3-4166-93da-f57b9d5a8834 req-9907bf0e-3ad9-4d68-909a-581e5272b17a service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:19 user nova-compute[75305]: WARNING nova.compute.manager [req-e31333f0-77e3-4166-93da-f57b9d5a8834 req-9907bf0e-3ad9-4d68-909a-581e5272b17a service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received unexpected event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with vm_state building and task_state spawning.
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:19 user nova-compute[75305]: INFO nova.compute.manager [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Detaching volume 6db2e303-2eec-40b7-9cfe-be0d9d23c6a5
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:19 user nova-compute[75305]: INFO nova.virt.block_device [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Attempting to driver detach volume 6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 from mountpoint /dev/vdc
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Attempting to detach device vdc from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:12:19 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:19 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:12:19 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:12:19 user nova-compute[75305]:   <serial>6db2e303-2eec-40b7-9cfe-be0d9d23c6a5</serial>
Nov 14 08:12:19 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 08:12:19 user nova-compute[75305]: </disk>
Nov 14 08:12:19 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:12:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Successfully detached device vdc from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the persistent domain config.
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:12:19 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:19 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:12:19 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:12:19 user nova-compute[75305]:   <serial>6db2e303-2eec-40b7-9cfe-be0d9d23c6a5</serial>
Nov 14 08:12:19 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 08:12:19 user nova-compute[75305]: </disk>
Nov 14 08:12:19 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:12:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:12:20 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance spawned successfully.
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:12:20 user nova-compute[75305]: INFO nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 14 08:12:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:20 user nova-compute[75305]: INFO nova.compute.manager [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Took 12.08 seconds to build instance.
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-947324e4-b0ef-49f6-8040-7dcc2eb13672 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.199s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.10425567626953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance dafc732a-81ec-412e-b237-1b18bd6cb577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance c837ffe0-c080-444e-a327-a7781f6d49bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 3c079358-a5f6-4294-84e9-df23abb78b90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba827b89-5258-4f7e-9e5d-eb13f35affd4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:12:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:12:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:12:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:12:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:12:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:12:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:12:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:12:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updating instance_info_cache with network_info: [{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:12:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:12:37 user nova-compute[75305]: INFO nova.compute.claims [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Claim successful on node user
Nov 14 08:12:37 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c837ffe0-c080-444e-a327-a7781f6d49bc is timed out.
Nov 14 08:12:37 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully detached device vdc from instance c837ffe0-c080-444e-a327-a7781f6d49bc from the live domain config.
Nov 14 08:12:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUYnQrIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:37 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f914f1-a939-4e94-b8ef-055b5838bcc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:12:37 user nova-compute[75305]: No targets found.
Nov 14 08:12:37 user nova-compute[75305]: iSNS:
Nov 14 08:12:37 user nova-compute[75305]: No targets found.
Nov 14 08:12:37 user nova-compute[75305]: STATIC:
Nov 14 08:12:37 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:12:37 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:37 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:37 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2
Nov 14 08:12:37 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:37 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:37 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5
Nov 14 08:12:37 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:37 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:37 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808
Nov 14 08:12:37 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:37 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:37 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:12:37 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:37 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:37 user nova-compute[75305]: FIRMWARE:
Nov 14 08:12:37 user nova-compute[75305]: No targets found.
Nov 14 08:12:37 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:12:37 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:12:37 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[143f0103-9d5e-471b-9913-e8d70bb73852]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a26f2a-c507-4217-8f8c-5c62f752ced2]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:37 user nova-compute[75305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)
Nov 14 08:12:37 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5c1f04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808'): ({'sdf'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Removing single pathed devices sdf {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee70aff-6d87-422e-90a3-31b33fd5e5af]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a435607c-3d9a-40e3-ae74-182fdf98b8f1]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flushing IO for device /dev/sdf {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f60d1c-a06d-4bad-b34b-64b37430112a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f862005-21fc-48e6-b25e-81195c378082]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:12:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f63f6de-b1c9-438b-9de0-7d858fbabbcd]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff13927-ceb4-4745-99a2-0d90102d7e0b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260]
Nov 14 08:12:38 user nova-compute[75305]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808, portal: 172.16.0.220,3260] successful.
Nov 14 08:12:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2afada73-2627-4b1a-a097-bac0bcf3c808 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9a2189-adb8-4b7c-8efb-07ecbba279f7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] <== disconnect_volume: return (321ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:12:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.policy [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6921b8792c4b4f098ee61c6d8bc840c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aeba260be7f045959c391eb65633be89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:12:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Creating image(s)
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "/opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.193s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk 1073741824" returned: 0 in 0.051s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'flavor' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Successfully created port: 08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.210s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c1d7ccac-0ce9-40de-ae2b-6a31ef0e84e1 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.133s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Cannot resize image /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Ensure instance console log exists: /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Successfully updated port: 08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-changed-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Refreshing instance network info cache due to event network-changed-82107e76-9d06-4dd8-917b-6c9a81233786. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] Acquiring lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] Acquired lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.network.neutron [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Refreshing network info cache for port 82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquired lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-changed-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Refreshing instance network info cache due to event network-changed-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] Acquiring lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:12:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Updating instance_info_cache with network_info: [{"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Releasing lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Instance network_info: |[{"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] Acquired lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Refreshing network info cache for port 08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Start _get_guest_xml network_info=[{"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:12:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1561045193',display_name='tempest-AttachVolumeNegativeTest-server-1561045193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1561045193',id=28,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1jzxa/1vxKhZR3lbOEmitgAhR0BPJTzGhuNasIg99EMi6gkFPdfXyjDWlrl1QsYmXFU59UbVkjZ0IZvuB4eqfbF51fROIBNBmUhVRbF3axpHk0ewnIGsXIJDIYapOyA==',key_name='tempest-keypair-1371442622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-v3dxhimr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:12:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4d:8f,bridge_name='br-int',has_traffic_filtering=True,id=08c62ea5-1270-4cf2-9f5f-38fa6e8038a7,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c62ea5-12') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'pci_devices' on Instance uuid a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance dafc732a-81ec-412e-b237-1b18bd6cb577 is timed out.
Nov 14 08:12:40 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Successfully detached device vdc from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the live domain config.
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:12:40 user nova-compute[75305]:   <uuid>a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0</uuid>
Nov 14 08:12:40 user nova-compute[75305]:   <name>instance-0000001c</name>
Nov 14 08:12:40 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:12:40 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:12:40 user nova-compute[75305]:   <metadata>
Nov 14 08:12:40 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:12:40 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:12:40 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1561045193</nova:name>
Nov 14 08:12:40 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:12:40</nova:creationTime>
Nov 14 08:12:40 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:12:40 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:12:40 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:12:40 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:12:40 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:12:40 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:12:40 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:12:40 user nova-compute[75305]:       <nova:owner>
Nov 14 08:12:40 user nova-compute[75305]:         <nova:user uuid="6921b8792c4b4f098ee61c6d8bc840c9">tempest-AttachVolumeNegativeTest-1514251643-project-member</nova:user>
Nov 14 08:12:40 user nova-compute[75305]:         <nova:project uuid="aeba260be7f045959c391eb65633be89">tempest-AttachVolumeNegativeTest-1514251643</nova:project>
Nov 14 08:12:40 user nova-compute[75305]:       </nova:owner>
Nov 14 08:12:40 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:12:40 user nova-compute[75305]:       <nova:ports>
Nov 14 08:12:40 user nova-compute[75305]:         <nova:port uuid="08c62ea5-1270-4cf2-9f5f-38fa6e8038a7">
Nov 14 08:12:40 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 08:12:40 user nova-compute[75305]:         </nova:port>
Nov 14 08:12:40 user nova-compute[75305]:       </nova:ports>
Nov 14 08:12:40 user nova-compute[75305]:     </nova:instance>
Nov 14 08:12:40 user nova-compute[75305]:   </metadata>
Nov 14 08:12:40 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:12:40 user nova-compute[75305]:     <system>
Nov 14 08:12:40 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:12:40 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:12:40 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:12:40 user nova-compute[75305]:       <entry name="serial">a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0</entry>
Nov 14 08:12:40 user nova-compute[75305]:       <entry name="uuid">a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0</entry>
Nov 14 08:12:40 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:12:40 user nova-compute[75305]:     </system>
Nov 14 08:12:40 user nova-compute[75305]:   </sysinfo>
Nov 14 08:12:40 user nova-compute[75305]:   <os>
Nov 14 08:12:40 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:12:40 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:12:40 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:12:40 user nova-compute[75305]:   </os>
Nov 14 08:12:40 user nova-compute[75305]:   <features>
Nov 14 08:12:40 user nova-compute[75305]:     <acpi/>
Nov 14 08:12:40 user nova-compute[75305]:     <apic/>
Nov 14 08:12:40 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:12:40 user nova-compute[75305]:   </features>
Nov 14 08:12:40 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:12:40 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:12:40 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:12:40 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:12:40 user nova-compute[75305]:   </clock>
Nov 14 08:12:40 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:12:40 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:12:40 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:12:40 user nova-compute[75305]:   </cpu>
Nov 14 08:12:40 user nova-compute[75305]:   <devices>
Nov 14 08:12:40 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:12:40 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:12:40 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk"/>
Nov 14 08:12:40 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:12:40 user nova-compute[75305]:     </disk>
Nov 14 08:12:40 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:12:40 user nova-compute[75305]:       <mac address="fa:16:3e:b3:4d:8f"/>
Nov 14 08:12:40 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:12:40 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:12:40 user nova-compute[75305]:       <target dev="tap08c62ea5-12"/>
Nov 14 08:12:40 user nova-compute[75305]:     </interface>
Nov 14 08:12:40 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:12:40 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/console.log" append="off"/>
Nov 14 08:12:40 user nova-compute[75305]:     </serial>
Nov 14 08:12:40 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:12:40 user nova-compute[75305]:     <video>
Nov 14 08:12:40 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:12:40 user nova-compute[75305]:     </video>
Nov 14 08:12:40 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:12:40 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:12:40 user nova-compute[75305]:     </rng>
Nov 14 08:12:40 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:12:40 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:12:40 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:12:40 user nova-compute[75305]:     </memballoon>
Nov 14 08:12:40 user nova-compute[75305]:   </devices>
Nov 14 08:12:40 user nova-compute[75305]: </domain>
Nov 14 08:12:40 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1561045193',display_name='tempest-AttachVolumeNegativeTest-server-1561045193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1561045193',id=28,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1jzxa/1vxKhZR3lbOEmitgAhR0BPJTzGhuNasIg99EMi6gkFPdfXyjDWlrl1QsYmXFU59UbVkjZ0IZvuB4eqfbF51fROIBNBmUhVRbF3axpHk0ewnIGsXIJDIYapOyA==',key_name='tempest-keypair-1371442622',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-v3dxhimr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:12:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4d:8f,bridge_name='br-int',has_traffic_filtering=True,id=08c62ea5-1270-4cf2-9f5f-38fa6e8038a7,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c62ea5-12') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_vif [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4d:8f,bridge_name='br-int',has_traffic_filtering=True,id=08c62ea5-1270-4cf2-9f5f-38fa6e8038a7,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c62ea5-12') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'efda222d-6d6e-53ef-8f45-2732669da0be', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Updated VIF entry in instance network info cache for port 82107e76-9d06-4dd8-917b-6c9a81233786. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Updating instance_info_cache with network_info: [{"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRaXlqA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:40 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08c62ea5-12, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08c62ea5-12, col_values=(('qos', UUID('d3f53109-3085-4bb6-86ed-04959ae6b535')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08c62ea5-12, col_values=(('external_ids', {'iface-id': '08c62ea5-1270-4cf2-9f5f-38fa6e8038a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:4d:8f', 'vm-uuid': 'a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aef0f8e4-0501-43d2-8e80-50a27d502248 req-842e929f-919c-4e12-82f4-26aacf28f30a service nova] Releasing lock "refresh_cache-3c079358-a5f6-4294-84e9-df23abb78b90" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:40 user nova-compute[75305]: INFO os_vif [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:4d:8f,bridge_name='br-int',has_traffic_filtering=True,id=08c62ea5-1270-4cf2-9f5f-38fa6e8038a7,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c62ea5-12')
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54eb8e5-67ce-4aab-817f-9390abab23de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:12:40 user nova-compute[75305]: No targets found.
Nov 14 08:12:40 user nova-compute[75305]: iSNS:
Nov 14 08:12:40 user nova-compute[75305]: No targets found.
Nov 14 08:12:40 user nova-compute[75305]: STATIC:
Nov 14 08:12:40 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:12:40 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:40 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:40 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2
Nov 14 08:12:40 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:40 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:40 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5
Nov 14 08:12:40 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:40 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:40 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:12:40 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:12:40 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:12:40 user nova-compute[75305]: FIRMWARE:
Nov 14 08:12:40 user nova-compute[75305]: No targets found.
Nov 14 08:12:40 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:12:40 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:12:40 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d6a540-07a4-47f1-b402-e17c8f835e60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No VIF found with MAC fa:16:3e:b3:4d:8f, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be9455e-7754-4b55-89d4-0eb121160745]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:40 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:40 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:40 user nova-compute[75305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)
Nov 14 08:12:40 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:40 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:40 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:40 user nova-compute[75305]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 (non-flash)
Nov 14 08:12:40 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf20765ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1df5652-1922-46e4-9d7a-162287970f78]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb643ed-dc49-40d6-a496-8bfe1c9a0ca2]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5671d855-2e0e-4d4f-9342-aaea3f5db2d5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbab492-b731-4b93-b693-45378f96c9ed]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acd6778-6683-4c62-a031-8db1366d4924]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[28599dcf-4366-4cff-baff-357c08290ef4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260]
Nov 14 08:12:40 user nova-compute[75305]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5, portal: 172.16.0.220,3260] successful.
Nov 14 08:12:40 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Updated VIF entry in instance network info cache for port 08c62ea5-1270-4cf2-9f5f-38fa6e8038a7. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Updating instance_info_cache with network_info: [{"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db2e303-2eec-40b7-9cfe-be0d9d23c6a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a592f751-7422-490d-b0a5-b577207e5a8b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] <== disconnect_volume: return (334ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:12:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c4bfe916-050a-4354-be9b-caee0110e00d req-9528743b-a119-45a0-bb87-f0e79169c1ee service nova] Releasing lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'flavor' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f91f4acc-5c31-4ff7-9686-e4a7cae856ba tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.756s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-ff6f0676-a73d-46f3-bc05-9d42d892895c req-5754b14a-a5b8-4e21-89c8-b68ed8eef2fa service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff6f0676-a73d-46f3-bc05-9d42d892895c req-5754b14a-a5b8-4e21-89c8-b68ed8eef2fa service nova] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff6f0676-a73d-46f3-bc05-9d42d892895c req-5754b14a-a5b8-4e21-89c8-b68ed8eef2fa service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff6f0676-a73d-46f3-bc05-9d42d892895c req-5754b14a-a5b8-4e21-89c8-b68ed8eef2fa service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-ff6f0676-a73d-46f3-bc05-9d42d892895c req-5754b14a-a5b8-4e21-89c8-b68ed8eef2fa service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] No waiting events found dispatching network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:41 user nova-compute[75305]: WARNING nova.compute.manager [req-ff6f0676-a73d-46f3-bc05-9d42d892895c req-5754b14a-a5b8-4e21-89c8-b68ed8eef2fa service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received unexpected event network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 for instance with vm_state building and task_state spawning.
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG nova.objects.instance [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lazy-loading 'flavor' on Instance uuid 3c079358-a5f6-4294-84e9-df23abb78b90 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:42 user nova-compute[75305]: INFO nova.compute.manager [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Attaching volume dc0f6e4d-0f46-4300-88d4-01cc5b85de4b to /dev/vdb
Nov 14 08:12:42 user nova-compute[75305]: DEBUG os_brick.utils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb0caf-5ca4-462f-b651-d3ec1b08bfb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[622d9b78-bff6-4e38-86f1-61a2d4d2e7fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f97b29-6290-40d7-816b-5f57054e57df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[87379531-e57a-4526-8cbb-a59aa7a1d7b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:12:42 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:12:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdc19cc-0e68-468a-8c96-36e03903488c]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG os_brick.utils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:42 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Updating existing volume attachment record: d54bee0f-55b2-4f1b-a27f-8dca9d543da9 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:12:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Instance spawned successfully.
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-d8c1f3a4-a3fc-4455-9a98-6bbf5c179c94 req-abc3be93-a9f6-48e7-9fc9-b6f1899a9461 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8c1f3a4-a3fc-4455-9a98-6bbf5c179c94 req-abc3be93-a9f6-48e7-9fc9-b6f1899a9461 service nova] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8c1f3a4-a3fc-4455-9a98-6bbf5c179c94 req-abc3be93-a9f6-48e7-9fc9-b6f1899a9461 service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8c1f3a4-a3fc-4455-9a98-6bbf5c179c94 req-abc3be93-a9f6-48e7-9fc9-b6f1899a9461 service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-d8c1f3a4-a3fc-4455-9a98-6bbf5c179c94 req-abc3be93-a9f6-48e7-9fc9-b6f1899a9461 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] No waiting events found dispatching network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:12:43 user nova-compute[75305]: WARNING nova.compute.manager [req-d8c1f3a4-a3fc-4455-9a98-6bbf5c179c94 req-abc3be93-a9f6-48e7-9fc9-b6f1899a9461 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received unexpected event network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 for instance with vm_state building and task_state spawning.
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:12:44 user nova-compute[75305]: INFO nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 14 08:12:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:12:44 user nova-compute[75305]: INFO nova.compute.manager [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Took 6.47 seconds to build instance.
Nov 14 08:12:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a35decbb-aff5-46b5-8635-52f7edb5ebb3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.559s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzarpKWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:12:47 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:47 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:12:47 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0db1a-8230-4fe3-ade9-b4186cede844]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:12:47 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff12d169-cd36-4441-8cd7-118b080a5513]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b] added
Nov 14 08:12:47 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11811ba9-6344-45eb-8295-c010d3967a40]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb68209c-783d-44c2-b91c-12a8fede894a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzarpKWP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SzarpKWP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba492182-8b41-4108-aade-d06c4e936495]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SzarpKWP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92ee4af-4bb8-47f7-b578-63025f2ddb23]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fb3611-495e-4181-ad15-09b993531b5c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:47 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:47 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1585361-6f05-440e-8bab-0e2cbddd5428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260]
Nov 14 08:12:47 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260] successful.
Nov 14 08:12:47 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f348b4-e1ef-473e-bec7-222774a4b64a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[005b4df8-a1f7-4ca8-81d0-782690fbc1e4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:12:47 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:12:47 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:12:47 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[074de82c-e690-4f32-9cc2-13ae8748fbad]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:12:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzarpKWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:12:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:12:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23938366533343236', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:12:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938366533343236', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:12:48 user nova-compute[75305]: DEBUG nova.objects.instance [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lazy-loading 'flavor' on Instance uuid 3c079358-a5f6-4294-84e9-df23abb78b90 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:12:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:12:48 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:48 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:12:48 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:12:48 user nova-compute[75305]:   <serial>dc0f6e4d-0f46-4300-88d4-01cc5b85de4b</serial>
Nov 14 08:12:48 user nova-compute[75305]: </disk>
Nov 14 08:12:48 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:12:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:12:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] No VIF found with MAC fa:16:3e:c3:f7:0f, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:12:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f9aa3ed-64f9-49ba-a932-2c8edc82760d tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.753s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:50 user nova-compute[75305]: INFO nova.compute.manager [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Detaching volume dc0f6e4d-0f46-4300-88d4-01cc5b85de4b
Nov 14 08:12:50 user nova-compute[75305]: INFO nova.virt.block_device [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Attempting to driver detach volume dc0f6e4d-0f46-4300-88d4-01cc5b85de4b from mountpoint /dev/vdb
Nov 14 08:12:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Attempting to detach device vdb from instance 3c079358-a5f6-4294-84e9-df23abb78b90 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:12:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:12:50 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:50 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:12:50 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:12:50 user nova-compute[75305]:   <serial>dc0f6e4d-0f46-4300-88d4-01cc5b85de4b</serial>
Nov 14 08:12:50 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:12:50 user nova-compute[75305]: </disk>
Nov 14 08:12:50 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:12:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Successfully detached device vdb from instance 3c079358-a5f6-4294-84e9-df23abb78b90 from the persistent domain config.
Nov 14 08:12:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c079358-a5f6-4294-84e9-df23abb78b90 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:12:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:12:50 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:12:50 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:12:50 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:12:50 user nova-compute[75305]:   <serial>dc0f6e4d-0f46-4300-88d4-01cc5b85de4b</serial>
Nov 14 08:12:50 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:12:50 user nova-compute[75305]: </disk>
Nov 14 08:12:50 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:12:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c079358-a5f6-4294-84e9-df23abb78b90 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:12:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:12:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:58 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:12:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:12:58 user nova-compute[75305]: INFO nova.compute.claims [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Claim successful on node user
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:12:59 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.policy [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7906829f99049d2bb0a97c80917cb3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b880ff94ef40409fe2b772dee93662', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:12:59 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Creating image(s)
Nov 14 08:12:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "/opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "/opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "/opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ac5a8080616dc1b4c048b54e43f6f7c2b5391d72" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:12:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ac5a8080616dc1b4c048b54e43f6f7c2b5391d72" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Successfully created port: d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-changed-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Refreshing instance network info cache due to event network-changed-eac08684-f54c-4430-898e-099dcd15a69d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] Acquiring lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] Acquired lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Refreshing network info cache for port eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.part --force-share --output=json" returned: 0 in 0.202s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.virt.images [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] e2f5047e-7a0b-407a-8593-a0aa79e34085 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.part /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.part /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.converted" returned: 0 in 0.276s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Updated VIF entry in instance network info cache for port eac08684-f54c-4430-898e-099dcd15a69d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG nova.network.neutron [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Updating instance_info_cache with network_info: [{"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72.converted --force-share --output=json" returned: 0 in 0.222s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ac5a8080616dc1b4c048b54e43f6f7c2b5391d72" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.224s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8bb98c9-1416-4320-8261-31397b3e8b08 req-fb4289a9-2bb8-4760-98b6-108569853b5a service nova] Releasing lock "refresh_cache-fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72 --force-share --output=json" returned: 0 in 0.202s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ac5a8080616dc1b4c048b54e43f6f7c2b5391d72" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ac5a8080616dc1b4c048b54e43f6f7c2b5391d72" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Successfully updated port: d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72 --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72,backing_fmt=raw /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing instance network info cache due to event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72,backing_fmt=raw /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk 1073741824" returned: 0 in 0.060s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ac5a8080616dc1b4c048b54e43f6f7c2b5391d72" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lazy-loading 'flavor' on Instance uuid fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72 --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance network_info: |[{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:01 user nova-compute[75305]: INFO nova.compute.manager [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Attaching volume c512e429-e84c-4934-934e-51286f4b6e18 to /dev/vdb
Nov 14 08:13:01 user nova-compute[75305]: DEBUG os_brick.utils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83528bb6-446e-411e-9baf-4fbcfa2baad0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Cannot resize image /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Ensure instance console log exists: /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Start _get_guest_xml network_info=[{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T08:12:56Z,direct_url=<?>,disk_format='qcow2',id=e2f5047e-7a0b-407a-8593-a0aa79e34085,min_disk=0,min_ram=0,name='tempest-scenario-img--913299361',owner='21b880ff94ef40409fe2b772dee93662',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T08:12:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': 'e2f5047e-7a0b-407a-8593-a0aa79e34085'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:13:01 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:13:01 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[096eb1dc-f13e-4755-867b-f48ff81f1048]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T08:12:56Z,direct_url=<?>,disk_format='qcow2',id=e2f5047e-7a0b-407a-8593-a0aa79e34085,min_disk=0,min_ram=0,name='tempest-scenario-img--913299361',owner='21b880ff94ef40409fe2b772dee93662',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T08:12:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1658184934',display_name='tempest-TestMinimumBasicScenario-server-1658184934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1658184934',id=29,image_ref='e2f5047e-7a0b-407a-8593-a0aa79e34085',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED3cvT+kgEr0gKriVno4jkRgUS8y+7LSlup37wKilRo+LuBbz/cevjLkzq1INV25dxtRuPpwVWpfTv3BRhDZHg9b6e97kdWGyi58sF8b/0KHro/3ENaUfN73aUD3lVLlA==',key_name='tempest-TestMinimumBasicScenario-746307838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-89rhk0sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e2f5047e-7a0b-407a-8593-a0aa79e34085',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:12:59Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=ba89d1e7-a713-49c3-bed9-317725c13f1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:24:8d,bridge_name='br-int',has_traffic_filtering=True,id=d223db2f-fbcd-4b02-bc61-1455cbb63a7a,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd223db2f-fb') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.objects.instance [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'pci_devices' on Instance uuid ba89d1e7-a713-49c3-bed9-317725c13f1c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ada5dd8-ae31-4b46-a7a5-f53928a681b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[87167f01-2a24-4274-887d-7eb10d8809fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:13:01 user nova-compute[75305]:   <uuid>ba89d1e7-a713-49c3-bed9-317725c13f1c</uuid>
Nov 14 08:13:01 user nova-compute[75305]:   <name>instance-0000001d</name>
Nov 14 08:13:01 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:13:01 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:13:01 user nova-compute[75305]:   <metadata>
Nov 14 08:13:01 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:13:01 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:13:01 user nova-compute[75305]:       <nova:name>tempest-TestMinimumBasicScenario-server-1658184934</nova:name>
Nov 14 08:13:01 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:13:01</nova:creationTime>
Nov 14 08:13:01 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:13:01 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:13:01 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:13:01 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:13:01 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:13:01 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:13:01 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:13:01 user nova-compute[75305]:       <nova:owner>
Nov 14 08:13:01 user nova-compute[75305]:         <nova:user uuid="f7906829f99049d2bb0a97c80917cb3a">tempest-TestMinimumBasicScenario-1127831644-project-member</nova:user>
Nov 14 08:13:01 user nova-compute[75305]:         <nova:project uuid="21b880ff94ef40409fe2b772dee93662">tempest-TestMinimumBasicScenario-1127831644</nova:project>
Nov 14 08:13:01 user nova-compute[75305]:       </nova:owner>
Nov 14 08:13:01 user nova-compute[75305]:       <nova:root type="image" uuid="e2f5047e-7a0b-407a-8593-a0aa79e34085"/>
Nov 14 08:13:01 user nova-compute[75305]:       <nova:ports>
Nov 14 08:13:01 user nova-compute[75305]:         <nova:port uuid="d223db2f-fbcd-4b02-bc61-1455cbb63a7a">
Nov 14 08:13:01 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:13:01 user nova-compute[75305]:         </nova:port>
Nov 14 08:13:01 user nova-compute[75305]:       </nova:ports>
Nov 14 08:13:01 user nova-compute[75305]:     </nova:instance>
Nov 14 08:13:01 user nova-compute[75305]:   </metadata>
Nov 14 08:13:01 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:13:01 user nova-compute[75305]:     <system>
Nov 14 08:13:01 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:13:01 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:13:01 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:13:01 user nova-compute[75305]:       <entry name="serial">ba89d1e7-a713-49c3-bed9-317725c13f1c</entry>
Nov 14 08:13:01 user nova-compute[75305]:       <entry name="uuid">ba89d1e7-a713-49c3-bed9-317725c13f1c</entry>
Nov 14 08:13:01 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:13:01 user nova-compute[75305]:     </system>
Nov 14 08:13:01 user nova-compute[75305]:   </sysinfo>
Nov 14 08:13:01 user nova-compute[75305]:   <os>
Nov 14 08:13:01 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:13:01 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:13:01 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:13:01 user nova-compute[75305]:   </os>
Nov 14 08:13:01 user nova-compute[75305]:   <features>
Nov 14 08:13:01 user nova-compute[75305]:     <acpi/>
Nov 14 08:13:01 user nova-compute[75305]:     <apic/>
Nov 14 08:13:01 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:13:01 user nova-compute[75305]:   </features>
Nov 14 08:13:01 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:13:01 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:13:01 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:13:01 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:13:01 user nova-compute[75305]:   </clock>
Nov 14 08:13:01 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:13:01 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:13:01 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:13:01 user nova-compute[75305]:   </cpu>
Nov 14 08:13:01 user nova-compute[75305]:   <devices>
Nov 14 08:13:01 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:13:01 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:13:01 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk"/>
Nov 14 08:13:01 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:13:01 user nova-compute[75305]:     </disk>
Nov 14 08:13:01 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:13:01 user nova-compute[75305]:       <mac address="fa:16:3e:5a:24:8d"/>
Nov 14 08:13:01 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:13:01 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:13:01 user nova-compute[75305]:       <target dev="tapd223db2f-fb"/>
Nov 14 08:13:01 user nova-compute[75305]:     </interface>
Nov 14 08:13:01 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:13:01 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/console.log" append="off"/>
Nov 14 08:13:01 user nova-compute[75305]:     </serial>
Nov 14 08:13:01 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:13:01 user nova-compute[75305]:     <video>
Nov 14 08:13:01 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:13:01 user nova-compute[75305]:     </video>
Nov 14 08:13:01 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:13:01 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:13:01 user nova-compute[75305]:     </rng>
Nov 14 08:13:01 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:13:01 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:13:01 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:13:01 user nova-compute[75305]:     </memballoon>
Nov 14 08:13:01 user nova-compute[75305]:   </devices>
Nov 14 08:13:01 user nova-compute[75305]: </domain>
Nov 14 08:13:01 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1658184934',display_name='tempest-TestMinimumBasicScenario-server-1658184934',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1658184934',id=29,image_ref='e2f5047e-7a0b-407a-8593-a0aa79e34085',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED3cvT+kgEr0gKriVno4jkRgUS8y+7LSlup37wKilRo+LuBbz/cevjLkzq1INV25dxtRuPpwVWpfTv3BRhDZHg9b6e97kdWGyi58sF8b/0KHro/3ENaUfN73aUD3lVLlA==',key_name='tempest-TestMinimumBasicScenario-746307838',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-89rhk0sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e2f5047e-7a0b-407a-8593-a0aa79e34085',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:12:59Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=ba89d1e7-a713-49c3-bed9-317725c13f1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:24:8d,bridge_name='br-int',has_traffic_filtering=True,id=d223db2f-fbcd-4b02-bc61-1455cbb63a7a,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd223db2f-fb') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG os_vif [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:24:8d,bridge_name='br-int',has_traffic_filtering=True,id=d223db2f-fbcd-4b02-bc61-1455cbb63a7a,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd223db2f-fb') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:13:01 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5429049-8ef8-4eb0-a94b-9d2fd2fc13fb]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e693a81-0789-5d77-a3cc-b96cc2a2ef0d', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG os_brick.utils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Updating existing volume attachment record: 14359666-987d-4c94-b1a8-bbb34db3bd72 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd223db2f-fb, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd223db2f-fb, col_values=(('qos', UUID('f3af4847-e014-49d7-93ba-08a337dd6f1e')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd223db2f-fb, col_values=(('external_ids', {'iface-id': 'd223db2f-fbcd-4b02-bc61-1455cbb63a7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:24:8d', 'vm-uuid': 'ba89d1e7-a713-49c3-bed9-317725c13f1c'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:01 user nova-compute[75305]: INFO os_vif [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:24:8d,bridge_name='br-int',has_traffic_filtering=True,id=d223db2f-fbcd-4b02-bc61-1455cbb63a7a,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd223db2f-fb')
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No VIF found with MAC fa:16:3e:5a:24:8d, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updated VIF entry in instance network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48c41eff-3b56-4d65-954d-8b1d3a63798f req-20867453-c4d7-43c4-9f23-45eec36019d2 service nova] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-48a3975e-1ee8-47a7-998d-59961c8c7f11 req-0ba5b181-19c5-4404-9639-bb8a975a0f87 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48a3975e-1ee8-47a7-998d-59961c8c7f11 req-0ba5b181-19c5-4404-9639-bb8a975a0f87 service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48a3975e-1ee8-47a7-998d-59961c8c7f11 req-0ba5b181-19c5-4404-9639-bb8a975a0f87 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-48a3975e-1ee8-47a7-998d-59961c8c7f11 req-0ba5b181-19c5-4404-9639-bb8a975a0f87 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-48a3975e-1ee8-47a7-998d-59961c8c7f11 req-0ba5b181-19c5-4404-9639-bb8a975a0f87 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:03 user nova-compute[75305]: WARNING nova.compute.manager [req-48a3975e-1ee8-47a7-998d-59961c8c7f11 req-0ba5b181-19c5-4404-9639-bb8a975a0f87 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state building and task_state spawning.
Nov 14 08:13:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:13:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance spawned successfully.
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-40b7fbb6-2814-4455-8b9d-708151aff345 req-eced643e-a32a-44a5-a5ed-f035462ff367 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-40b7fbb6-2814-4455-8b9d-708151aff345 req-eced643e-a32a-44a5-a5ed-f035462ff367 service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-40b7fbb6-2814-4455-8b9d-708151aff345 req-eced643e-a32a-44a5-a5ed-f035462ff367 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-40b7fbb6-2814-4455-8b9d-708151aff345 req-eced643e-a32a-44a5-a5ed-f035462ff367 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-40b7fbb6-2814-4455-8b9d-708151aff345 req-eced643e-a32a-44a5-a5ed-f035462ff367 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:05 user nova-compute[75305]: WARNING nova.compute.manager [req-40b7fbb6-2814-4455-8b9d-708151aff345 req-eced643e-a32a-44a5-a5ed-f035462ff367 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state building and task_state spawning.
Nov 14 08:13:05 user nova-compute[75305]: INFO nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:13:05 user nova-compute[75305]: INFO nova.compute.manager [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Took 6.58 seconds to build instance.
Nov 14 08:13:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ee1bd70a-6db6-426d-b95a-0037052742e1 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.684s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkSdKUTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:13:05 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:13:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:13:05 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:13:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:13:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:13:05 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:13:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaf53fe-7c9e-4a8b-a12c-f256215eab52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:13:06 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeb8fb2-d61b-4159-9ada-f0df49fbc7d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18] added
Nov 14 08:13:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef3a885-c857-4f10-afdf-b6e51c43fb10]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.110s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d42f26-418a-443c-a024-6a2817cb55ad]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkSdKUTz {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkSdKUTz" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb20fb03-4cf9-41ba-b272-054a45570dc2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkSdKUTz'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db09b2-40f8-4911-97ea-8c41abd7d037]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953686b-832d-4a7b-ae3f-62b899f14392]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:13:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:13:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958a36a-00a4-4d70-a5a1-6577b689f4c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260]
Nov 14 08:13:06 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260] successful.
Nov 14 08:13:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f506bc7a-7e69-45c0-a169-cc8afe8e7320]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f6d0ea-4f02-4838-8dfb-1ee9ae0a9808]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:13:06 user nova-compute[75305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)
Nov 14 08:13:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c5a441-92c8-4fa5-8095-10e03b59b5f9]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkSdKUTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:13:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:07 user nova-compute[75305]: INFO nova.compute.manager [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Terminating instance
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.441s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] <== connect_volume: return (1442ms) {'type': 'block', 'scsi_wwn': '26435346565336538', 'path': '/dev/sdf'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435346565336538', 'path': '/dev/sdf'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lazy-loading 'flavor' on Instance uuid fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:13:07 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:13:07 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:13:07 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:13:07 user nova-compute[75305]:   <serial>c512e429-e84c-4934-934e-51286f4b6e18</serial>
Nov 14 08:13:07 user nova-compute[75305]: </disk>
Nov 14 08:13:07 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-ac4c2619-f23b-4bb2-b3d3-a88cc4a7e4da req-78c2fdf2-ac72-4aae-9914-9bac496cf673 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ac4c2619-f23b-4bb2-b3d3-a88cc4a7e4da req-78c2fdf2-ac72-4aae-9914-9bac496cf673 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ac4c2619-f23b-4bb2-b3d3-a88cc4a7e4da req-78c2fdf2-ac72-4aae-9914-9bac496cf673 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ac4c2619-f23b-4bb2-b3d3-a88cc4a7e4da req-78c2fdf2-ac72-4aae-9914-9bac496cf673 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-ac4c2619-f23b-4bb2-b3d3-a88cc4a7e4da req-78c2fdf2-ac72-4aae-9914-9bac496cf673 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-ac4c2619-f23b-4bb2-b3d3-a88cc4a7e4da req-78c2fdf2-ac72-4aae-9914-9bac496cf673 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:13:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] No VIF found with MAC fa:16:3e:95:2b:4a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f3d0ac66-1446-42c4-a5fc-802fcbd99254 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.553s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Instance destroyed successfully.
Nov 14 08:13:08 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'resources' on Instance uuid c837ffe0-c080-444e-a327-a7781f6d49bc {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:06:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-113716200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-113716200',id=18,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLDoRF2EW+47Bp/aN3W1QZH6tyM1NlPXatd3hRlKIaElGDLN0se+vBXrBadawHdZo2kVdF6J1fpDCAGug/K7mO/BFgTr9VzotrFDcpPoWS/24a8nUL9bsxRSJuRfbdhug==',key_name='tempest-keypair-146649035',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:10:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-obbnhka4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:10:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=c837ffe0-c080-444e-a327-a7781f6d49bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "address": "fa:16:3e:bb:f4:55", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fc26dc0-37", "ovs_interfaceid": "2fc26dc0-37ee-4285-bb22-ec1f1c206301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG os_vif [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fc26dc0-37, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c82e7d3b-7884-473f-8f28-e2d8eb422b65) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:13:08 user nova-compute[75305]: INFO os_vif [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:f4:55,bridge_name='br-int',has_traffic_filtering=True,id=2fc26dc0-37ee-4285-bb22-ec1f1c206301,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fc26dc0-37')
Nov 14 08:13:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Deleting instance files /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc_del
Nov 14 08:13:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Deletion of /opt/stack/data/nova/instances/c837ffe0-c080-444e-a327-a7781f6d49bc_del complete
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: INFO nova.compute.manager [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 14 08:13:08 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:09 user nova-compute[75305]: WARNING nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state active and task_state deleting.
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:09 user nova-compute[75305]: WARNING nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state active and task_state deleting.
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:09 user nova-compute[75305]: WARNING nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state active and task_state deleting.
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-unplugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Acquiring lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] No waiting events found dispatching network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:09 user nova-compute[75305]: WARNING nova.compute.manager [req-2c5971ad-5667-405b-b122-34a7ef173255 req-4fe2f4f9-6dda-436b-8de1-86e873c27c59 service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received unexpected event network-vif-plugged-2fc26dc0-37ee-4285-bb22-ec1f1c206301 for instance with vm_state active and task_state deleting.
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:09 user nova-compute[75305]: INFO nova.compute.manager [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Detaching volume c512e429-e84c-4934-934e-51286f4b6e18
Nov 14 08:13:09 user nova-compute[75305]: INFO nova.virt.block_device [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Attempting to driver detach volume c512e429-e84c-4934-934e-51286f4b6e18 from mountpoint /dev/vdb
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Attempting to detach device vdb from instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:13:09 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:13:09 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:13:09 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:13:09 user nova-compute[75305]:   <serial>c512e429-e84c-4934-934e-51286f4b6e18</serial>
Nov 14 08:13:09 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:13:09 user nova-compute[75305]: </disk>
Nov 14 08:13:09 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:13:09 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Successfully detached device vdb from instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d from the persistent domain config.
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:13:09 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:13:09 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:13:09 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:13:09 user nova-compute[75305]:   <serial>c512e429-e84c-4934-934e-51286f4b6e18</serial>
Nov 14 08:13:09 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:13:09 user nova-compute[75305]: </disk>
Nov 14 08:13:09 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:09 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Took 1.31 seconds to deallocate network for instance.
Nov 14 08:13:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-c82109c8-baee-452e-8f05-454b758f96c4 req-4c26386f-7753-40d0-a0bd-a066373ddbce service nova] [instance: c837ffe0-c080-444e-a327-a7781f6d49bc] Received event network-vif-deleted-2fc26dc0-37ee-4285-bb22-ec1f1c206301 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:10 user nova-compute[75305]: INFO nova.compute.manager [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Detaching volume 7afa7c06-99ee-43b3-8390-b3f70a102bc2
Nov 14 08:13:10 user nova-compute[75305]: INFO nova.virt.block_device [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Attempting to driver detach volume 7afa7c06-99ee-43b3-8390-b3f70a102bc2 from mountpoint /dev/vdb
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Attempting to detach device vdb from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:13:10 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:13:10 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:13:10 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:13:10 user nova-compute[75305]:   <serial>7afa7c06-99ee-43b3-8390-b3f70a102bc2</serial>
Nov 14 08:13:10 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:13:10 user nova-compute[75305]: </disk>
Nov 14 08:13:10 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:13:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Successfully detached device vdb from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the persistent domain config.
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:13:10 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:13:10 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:13:10 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:13:10 user nova-compute[75305]:   <serial>7afa7c06-99ee-43b3-8390-b3f70a102bc2</serial>
Nov 14 08:13:10 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:13:10 user nova-compute[75305]: </disk>
Nov 14 08:13:10 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:10 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Deleted allocations for instance c837ffe0-c080-444e-a327-a7781f6d49bc
Nov 14 08:13:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d9833aa9-b5ab-45e5-95e1-113d028748be tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "c837ffe0-c080-444e-a327-a7781f6d49bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:13:11 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c079358-a5f6-4294-84e9-df23abb78b90 is timed out.
Nov 14 08:13:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Successfully detached device vdb from instance 3c079358-a5f6-4294-84e9-df23abb78b90 from the live domain config.
Nov 14 08:13:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SzarpKWP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:13:11 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d73cf5-a1fa-463e-9884-f03944d31c15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:13:11 user nova-compute[75305]: No targets found.
Nov 14 08:13:11 user nova-compute[75305]: iSNS:
Nov 14 08:13:11 user nova-compute[75305]: No targets found.
Nov 14 08:13:11 user nova-compute[75305]: STATIC:
Nov 14 08:13:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:13:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2
Nov 14 08:13:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:13:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18
Nov 14 08:13:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:11 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b
Nov 14 08:13:11 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:11 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:11 user nova-compute[75305]: FIRMWARE:
Nov 14 08:13:11 user nova-compute[75305]: No targets found.
Nov 14 08:13:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:13:11 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:13:11 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b283a1-6509-42b2-a141-38f805db7ea0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6968e924-ae27-465a-af54-af19d76d7163]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)
Nov 14 08:13:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b (non-flash)
Nov 14 08:13:11 user nova-compute[75305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)
Nov 14 08:13:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442ec550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d46e253-1545-43ae-ad7b-08eb18dd429d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfe560-69ee-4fbd-8931-822bf512c773]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd9df98-f4c3-42cb-952a-bef00b354c08]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931373b-389b-4112-9f89-33214ee3c783]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[077fd7e0-28bb-49b0-9846-43f6eceb5230]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1dd3e7-aeb7-44d5-ba95-b01770ff16ec]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260]
Nov 14 08:13:11 user nova-compute[75305]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b, portal: 172.16.0.220,3260] successful.
Nov 14 08:13:11 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc0f6e4d-0f46-4300-88d4-01cc5b85de4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f5be30-2cfe-4467-a8a2-44fbfe76abcf]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] <== disconnect_volume: return (312ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:13:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:13:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:13:12 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lazy-loading 'flavor' on Instance uuid 3c079358-a5f6-4294-84e9-df23abb78b90 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f588dea5-5af2-4352-8428-e70915d9c548 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.598s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:13:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:13:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:13:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7542MB free_disk=25.049896240234375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:13:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance dafc732a-81ec-412e-b237-1b18bd6cb577 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 3c079358-a5f6-4294-84e9-df23abb78b90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba827b89-5258-4f7e-9e5d-eb13f35affd4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba89d1e7-a713-49c3-bed9-317725c13f1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.718s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:13:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:13:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:13:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:13:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:30 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d is timed out.
Nov 14 08:13:30 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Successfully detached device vdb from instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d from the live domain config.
Nov 14 08:13:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkSdKUTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:13:30 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[186130d9-3a99-4119-bdb6-e739a6751ab7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:13:30 user nova-compute[75305]: No targets found.
Nov 14 08:13:30 user nova-compute[75305]: iSNS:
Nov 14 08:13:30 user nova-compute[75305]: No targets found.
Nov 14 08:13:30 user nova-compute[75305]: STATIC:
Nov 14 08:13:30 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:13:30 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:30 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:30 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2
Nov 14 08:13:30 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:30 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:30 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:13:30 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:30 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:30 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18
Nov 14 08:13:30 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:30 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:30 user nova-compute[75305]: FIRMWARE:
Nov 14 08:13:30 user nova-compute[75305]: No targets found.
Nov 14 08:13:30 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:13:30 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:13:30 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[55abcd41-76ca-42c3-bde3-64c06bb093aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff38888-9a61-4f5a-9eed-cece9a6caaac]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5c264dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18'): ({'sdf'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Removing single pathed devices sdf {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d501d5c-a271-4a28-a5f8-70a03e908447]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb3a579-b9ec-4f74-a500-af1dcdb6cbaf]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Flushing IO for device /dev/sdf {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f000bc8-ffe1-4686-9889-015b7e243339]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1471ab34-598f-4f1a-9e67-a782fee63a7f]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39557437-1d03-482b-9260-a3588e27842e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd01c2-8314-49d1-b706-a8b42fd76d9c]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260]
Nov 14 08:13:30 user nova-compute[75305]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18, portal: 172.16.0.220,3260] successful.
Nov 14 08:13:30 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c512e429-e84c-4934-934e-51286f4b6e18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c045c7a-1f48-4d9f-97b0-efa9e4598f11]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] <== disconnect_volume: return (322ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:13:30 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dafc732a-81ec-412e-b237-1b18bd6cb577 is timed out.
Nov 14 08:13:30 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Successfully detached device vdb from instance dafc732a-81ec-412e-b237-1b18bd6cb577 from the live domain config.
Nov 14 08:13:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SnefDVpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:13:30 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a730d-c820-4cc8-9e7a-a4bc9681f2d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:13:30 user nova-compute[75305]: No targets found.
Nov 14 08:13:30 user nova-compute[75305]: iSNS:
Nov 14 08:13:30 user nova-compute[75305]: No targets found.
Nov 14 08:13:30 user nova-compute[75305]: STATIC:
Nov 14 08:13:30 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:13:30 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:30 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:30 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2
Nov 14 08:13:30 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:30 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:30 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:13:30 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:13:30 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:13:30 user nova-compute[75305]: FIRMWARE:
Nov 14 08:13:30 user nova-compute[75305]: No targets found.
Nov 14 08:13:30 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:13:30 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:13:30 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[540ccc5b-251a-4c65-b705-e1262d46e3ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e1a636-bc2b-444f-9347-92be015b782d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:30 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 (non-flash)
Nov 14 08:13:30 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:30 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442a9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1143d0-b09e-49e8-ae94-51b6ca1ca89d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6acedc-2534-4617-b647-7c173df644ec]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2ab369-f715-4fce-9b2e-a2684841b063]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8467c45c-09aa-41da-ac7d-8387eec3d9fd]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf9d3c-5733-44d5-874f-ae1b90c59c2f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2273b3ab-5b7e-472a-8364-3b16570837b2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260]
Nov 14 08:13:31 user nova-compute[75305]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2, portal: 172.16.0.220,3260] successful.
Nov 14 08:13:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7afa7c06-99ee-43b3-8390-b3f70a102bc2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1a44ef-70d9-4be6-9526-f7f4e795ed9f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] <== disconnect_volume: return (323ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lazy-loading 'flavor' on Instance uuid fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f86239f3-64bc-4c82-b06e-7907122b57c0 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.642s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'flavor' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6ddf4331-2ca1-4d23-b9f4-2b6cfaab7d87 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.676s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:13:40 user nova-compute[75305]: INFO nova.compute.claims [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Claim successful on node user
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:13:40 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.policy [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '574c9a82a4994bdcb60c5d96b199d69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a93139587f4dc0b2bd586961056c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:13:40 user nova-compute[75305]: INFO nova.virt.block_device [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Booting with volume b9f10f8c-67dd-4327-b9d9-13d80279f96b at /dev/vda
Nov 14 08:13:40 user nova-compute[75305]: DEBUG os_brick.utils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ce6ae0-178d-490a-80a5-0701ec5e7592]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca420a-8b99-45b7-9996-614c0576a5a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a424b9e2-95ed-46bc-b58d-df603dcc24d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[437c9e3b-dacc-4ea0-8bd7-99e85e57ee6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:13:40 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:13:40 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59649ff-067f-4d72-bea9-0992943fabbe]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG os_brick.utils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:13:40 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating existing volume attachment record: 608cb2a0-99a8-4249-9a7b-41cc66f5925b {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Successfully created port: a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Successfully updated port: a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquired lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-changed-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Refreshing instance network info cache due to event network-changed-a93393fb-68b8-4ff0-a390-517a385f6c92. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:13:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] Acquiring lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Releasing lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance network_info: |[{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] Acquired lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG nova.network.neutron [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Refreshing network info cache for port a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG nova.network.neutron [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updated VIF entry in instance network info cache for port a93393fb-68b8-4ff0-a390-517a385f6c92. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG nova.network.neutron [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7e301538-cb2a-4da4-b1d3-e88af325387c req-477dfb40-bc5e-4b6b-a66f-f443b5c6cd60 service nova] Releasing lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:43 user nova-compute[75305]: INFO nova.compute.manager [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Terminating instance
Nov 14 08:13:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3475aef-f9b6-46a7-8361-04ff3ecaf895 req-0860c77d-f304-4cd6-a8f7-fe7ce2a44e66 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-vif-unplugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3475aef-f9b6-46a7-8361-04ff3ecaf895 req-0860c77d-f304-4cd6-a8f7-fe7ce2a44e66 service nova] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3475aef-f9b6-46a7-8361-04ff3ecaf895 req-0860c77d-f304-4cd6-a8f7-fe7ce2a44e66 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3475aef-f9b6-46a7-8361-04ff3ecaf895 req-0860c77d-f304-4cd6-a8f7-fe7ce2a44e66 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3475aef-f9b6-46a7-8361-04ff3ecaf895 req-0860c77d-f304-4cd6-a8f7-fe7ce2a44e66 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] No waiting events found dispatching network-vif-unplugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3475aef-f9b6-46a7-8361-04ff3ecaf895 req-0860c77d-f304-4cd6-a8f7-fe7ce2a44e66 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-vif-unplugged-82107e76-9d06-4dd8-917b-6c9a81233786 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:13:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Instance destroyed successfully.
Nov 14 08:13:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lazy-loading 'resources' on Instance uuid 3c079358-a5f6-4294-84e9-df23abb78b90 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1378329075',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1378329075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1378329',id=25,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHlxnujSFPoyR39a/VyKocIqSuQLpfcrKioIlw296VdABDsDs8L70TCUgMCqb4FWlEHBv+mfoDmkGhdrn7BanfjWEafRNaa8Qn7Tj8ied4McdSc0XXHMbHonVRTLh/Db7Q==',key_name='tempest-keypair-1259986227',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:10:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d97b980e3aa04e5392d096152dd3999a',ramdisk_id='',reservation_id='r-0ha90lai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1599136510',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:10:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94942948e4d34e53bf9acfd04de75d8e',uuid=3c079358-a5f6-4294-84e9-df23abb78b90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Converting VIF {"id": "82107e76-9d06-4dd8-917b-6c9a81233786", "address": "fa:16:3e:c3:f7:0f", "network": {"id": "6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-739144643-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d97b980e3aa04e5392d096152dd3999a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82107e76-9d", "ovs_interfaceid": "82107e76-9d06-4dd8-917b-6c9a81233786", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f7:0f,bridge_name='br-int',has_traffic_filtering=True,id=82107e76-9d06-4dd8-917b-6c9a81233786,network=Network(6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82107e76-9d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG os_vif [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f7:0f,bridge_name='br-int',has_traffic_filtering=True,id=82107e76-9d06-4dd8-917b-6c9a81233786,network=Network(6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82107e76-9d') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82107e76-9d, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6a5720ba-2bfd-4283-8760-e9e8756658e7) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:44 user nova-compute[75305]: INFO os_vif [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:f7:0f,bridge_name='br-int',has_traffic_filtering=True,id=82107e76-9d06-4dd8-917b-6c9a81233786,network=Network(6a9898c0-aed8-4641-a1e3-a05b9ea3d2cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82107e76-9d')
Nov 14 08:13:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Deleting instance files /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90_del
Nov 14 08:13:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Deletion of /opt/stack/data/nova/instances/3c079358-a5f6-4294-84e9-df23abb78b90_del complete
Nov 14 08:13:44 user nova-compute[75305]: INFO nova.compute.manager [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 08:13:44 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:13:44 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:45 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Took 0.84 seconds to deallocate network for instance.
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-8e4df0de-e161-4995-bc60-d031e2516f35 req-9d320469-f231-426b-93fa-28c5d2969490 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-vif-deleted-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:13:45 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Creating image(s)
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Ensure instance console log exists: /opt/stack/data/nova/instances/961e2d61-c567-4861-974f-7cd205244bee/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Start _get_guest_xml network_info=[{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '608cb2a0-99a8-4249-9a7b-41cc66f5925b', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '961e2d61-c567-4861-974f-7cd205244bee', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'serial': 'b9f10f8c-67dd-4327-b9d9-13d80279f96b'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:45 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:13:45 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:13:45 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:13:45 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:13:45 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64a0ee-1e3f-428c-99cf-245f782d2a4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:13:45 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f87c59-7c8d-415d-aa8e-88c980cf1922]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b] added
Nov 14 08:13:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[261eaf8c-9258-49bf-b5a9-9a3f76e824d1]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7969c19f-0d8b-45c4-ba1f-5044b2aa9e50]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvZTPxIK {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvZTPxIK" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4b138b-3139-486a-8b07-0c8821fa2dd3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wvZTPxIK'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c01571-b302-4e81-81d3-0b46f6fd4a87]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a5aa3a-d7ee-4090-b19a-73370f101283]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:45 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:45 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cd15ab-38f6-4d4f-ade4-fb9e8987daeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]
Nov 14 08:13:45 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.
Nov 14 08:13:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7092882e-8ad3-4f54-b05f-685570c7c72e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f502c-53cb-4fe8-adfc-78f43a65d74f]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:45 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:45 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:13:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:13:45 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:13:45 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:13:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[44433fad-c02b-49bd-9ab0-eff044d12dfe]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:45 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Deleted allocations for instance 3c079358-a5f6-4294-84e9-df23abb78b90
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-11d9d6d7-5a35-456e-858a-2bcdfa7e2ba5 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510 tempest-TestServerVolumeAttachScenarioOldVersion-1599136510-project-member] Lock "3c079358-a5f6-4294-84e9-df23abb78b90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-8646213e-67de-464c-aa47-63a492f283d5 req-5d991324-4083-4825-a7a2-90eb48140714 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received event network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8646213e-67de-464c-aa47-63a492f283d5 req-5d991324-4083-4825-a7a2-90eb48140714 service nova] Acquiring lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8646213e-67de-464c-aa47-63a492f283d5 req-5d991324-4083-4825-a7a2-90eb48140714 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8646213e-67de-464c-aa47-63a492f283d5 req-5d991324-4083-4825-a7a2-90eb48140714 service nova] Lock "3c079358-a5f6-4294-84e9-df23abb78b90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-8646213e-67de-464c-aa47-63a492f283d5 req-5d991324-4083-4825-a7a2-90eb48140714 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] No waiting events found dispatching network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:45 user nova-compute[75305]: WARNING nova.compute.manager [req-8646213e-67de-464c-aa47-63a492f283d5 req-5d991324-4083-4825-a7a2-90eb48140714 service nova] [instance: 3c079358-a5f6-4294-84e9-df23abb78b90] Received unexpected event network-vif-plugged-82107e76-9d06-4dd8-917b-6c9a81233786 for instance with vm_state deleted and task_state None.
Nov 14 08:13:46 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26133663563323636', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663563323636', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1141013763',display_name='tempest-ServerActionsTestOtherA-server-1141013763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1141013763',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-37g09cai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=961e2d61-c567-4861-974f-7cd205244bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.objects.instance [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'pci_devices' on Instance uuid 961e2d61-c567-4861-974f-7cd205244bee {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:13:46 user nova-compute[75305]:   <uuid>961e2d61-c567-4861-974f-7cd205244bee</uuid>
Nov 14 08:13:46 user nova-compute[75305]:   <name>instance-0000001e</name>
Nov 14 08:13:46 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:13:46 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:13:46 user nova-compute[75305]:   <metadata>
Nov 14 08:13:46 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:13:46 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:13:46 user nova-compute[75305]:       <nova:name>tempest-ServerActionsTestOtherA-server-1141013763</nova:name>
Nov 14 08:13:46 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:13:45</nova:creationTime>
Nov 14 08:13:46 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:13:46 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:13:46 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:13:46 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:13:46 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:13:46 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:13:46 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:13:46 user nova-compute[75305]:       <nova:owner>
Nov 14 08:13:46 user nova-compute[75305]:         <nova:user uuid="574c9a82a4994bdcb60c5d96b199d69a">tempest-ServerActionsTestOtherA-723782501-project-member</nova:user>
Nov 14 08:13:46 user nova-compute[75305]:         <nova:project uuid="34a93139587f4dc0b2bd586961056c6c">tempest-ServerActionsTestOtherA-723782501</nova:project>
Nov 14 08:13:46 user nova-compute[75305]:       </nova:owner>
Nov 14 08:13:46 user nova-compute[75305]:       <nova:ports>
Nov 14 08:13:46 user nova-compute[75305]:         <nova:port uuid="a93393fb-68b8-4ff0-a390-517a385f6c92">
Nov 14 08:13:46 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:13:46 user nova-compute[75305]:         </nova:port>
Nov 14 08:13:46 user nova-compute[75305]:       </nova:ports>
Nov 14 08:13:46 user nova-compute[75305]:     </nova:instance>
Nov 14 08:13:46 user nova-compute[75305]:   </metadata>
Nov 14 08:13:46 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:13:46 user nova-compute[75305]:     <system>
Nov 14 08:13:46 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:13:46 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:13:46 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:13:46 user nova-compute[75305]:       <entry name="serial">961e2d61-c567-4861-974f-7cd205244bee</entry>
Nov 14 08:13:46 user nova-compute[75305]:       <entry name="uuid">961e2d61-c567-4861-974f-7cd205244bee</entry>
Nov 14 08:13:46 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:13:46 user nova-compute[75305]:     </system>
Nov 14 08:13:46 user nova-compute[75305]:   </sysinfo>
Nov 14 08:13:46 user nova-compute[75305]:   <os>
Nov 14 08:13:46 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:13:46 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:13:46 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:13:46 user nova-compute[75305]:   </os>
Nov 14 08:13:46 user nova-compute[75305]:   <features>
Nov 14 08:13:46 user nova-compute[75305]:     <acpi/>
Nov 14 08:13:46 user nova-compute[75305]:     <apic/>
Nov 14 08:13:46 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:13:46 user nova-compute[75305]:   </features>
Nov 14 08:13:46 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:13:46 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:13:46 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:13:46 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:13:46 user nova-compute[75305]:   </clock>
Nov 14 08:13:46 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:13:46 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:13:46 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:13:46 user nova-compute[75305]:   </cpu>
Nov 14 08:13:46 user nova-compute[75305]:   <devices>
Nov 14 08:13:46 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:13:46 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:13:46 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:13:46 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:13:46 user nova-compute[75305]:       <serial>b9f10f8c-67dd-4327-b9d9-13d80279f96b</serial>
Nov 14 08:13:46 user nova-compute[75305]:     </disk>
Nov 14 08:13:46 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:13:46 user nova-compute[75305]:       <mac address="fa:16:3e:00:13:cc"/>
Nov 14 08:13:46 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:13:46 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:13:46 user nova-compute[75305]:       <target dev="tapa93393fb-68"/>
Nov 14 08:13:46 user nova-compute[75305]:     </interface>
Nov 14 08:13:46 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:13:46 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/961e2d61-c567-4861-974f-7cd205244bee/console.log" append="off"/>
Nov 14 08:13:46 user nova-compute[75305]:     </serial>
Nov 14 08:13:46 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:13:46 user nova-compute[75305]:     <video>
Nov 14 08:13:46 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:13:46 user nova-compute[75305]:     </video>
Nov 14 08:13:46 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:13:46 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:13:46 user nova-compute[75305]:     </rng>
Nov 14 08:13:46 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:13:46 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:13:46 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:13:46 user nova-compute[75305]:     </memballoon>
Nov 14 08:13:46 user nova-compute[75305]:   </devices>
Nov 14 08:13:46 user nova-compute[75305]: </domain>
Nov 14 08:13:46 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1141013763',display_name='tempest-ServerActionsTestOtherA-server-1141013763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1141013763',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-37g09cai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:13:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=961e2d61-c567-4861-974f-7cd205244bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG os_vif [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40513ca0-33f0-5d0f-93ca-399f4d3a8ba4', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa93393fb-68, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa93393fb-68, col_values=(('qos', UUID('85dcb478-ffe3-425b-92b4-1d21921c3530')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa93393fb-68, col_values=(('external_ids', {'iface-id': 'a93393fb-68b8-4ff0-a390-517a385f6c92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:13:cc', 'vm-uuid': '961e2d61-c567-4861-974f-7cd205244bee'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:46 user nova-compute[75305]: INFO os_vif [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68')
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:13:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No VIF found with MAC fa:16:3e:00:13:cc, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:13:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-cc6e0367-0685-47ed-a4c7-fd0152d78217 req-f465073e-4c46-4112-bc85-d235af4540d0 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc6e0367-0685-47ed-a4c7-fd0152d78217 req-f465073e-4c46-4112-bc85-d235af4540d0 service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc6e0367-0685-47ed-a4c7-fd0152d78217 req-f465073e-4c46-4112-bc85-d235af4540d0 service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc6e0367-0685-47ed-a4c7-fd0152d78217 req-f465073e-4c46-4112-bc85-d235af4540d0 service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-cc6e0367-0685-47ed-a4c7-fd0152d78217 req-f465073e-4c46-4112-bc85-d235af4540d0 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:48 user nova-compute[75305]: WARNING nova.compute.manager [req-cc6e0367-0685-47ed-a4c7-fd0152d78217 req-f465073e-4c46-4112-bc85-d235af4540d0 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state building and task_state spawning.
Nov 14 08:13:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:13:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance spawned successfully.
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:13:50 user nova-compute[75305]: INFO nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-b134315b-341e-4566-9c97-4d975ec9a1c2 req-75759a35-096a-42bc-939a-2d39b316bf0e service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b134315b-341e-4566-9c97-4d975ec9a1c2 req-75759a35-096a-42bc-939a-2d39b316bf0e service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b134315b-341e-4566-9c97-4d975ec9a1c2 req-75759a35-096a-42bc-939a-2d39b316bf0e service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b134315b-341e-4566-9c97-4d975ec9a1c2 req-75759a35-096a-42bc-939a-2d39b316bf0e service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-b134315b-341e-4566-9c97-4d975ec9a1c2 req-75759a35-096a-42bc-939a-2d39b316bf0e service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:50 user nova-compute[75305]: WARNING nova.compute.manager [req-b134315b-341e-4566-9c97-4d975ec9a1c2 req-75759a35-096a-42bc-939a-2d39b316bf0e service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state building and task_state spawning.
Nov 14 08:13:50 user nova-compute[75305]: INFO nova.compute.manager [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Took 10.13 seconds to build instance.
Nov 14 08:13:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fabadd1c-5b96-45ef-ba53-7e1a0726d028 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.224s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:52 user nova-compute[75305]: INFO nova.compute.manager [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Unrescuing
Nov 14 08:13:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG nova.objects.instance [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'flavor' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-4c06a718-ce09-407e-844a-f3018426d3ca req-a4436d54-e4b0-48fc-822a-51373b5d9b9d service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4c06a718-ce09-407e-844a-f3018426d3ca req-a4436d54-e4b0-48fc-822a-51373b5d9b9d service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4c06a718-ce09-407e-844a-f3018426d3ca req-a4436d54-e4b0-48fc-822a-51373b5d9b9d service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4c06a718-ce09-407e-844a-f3018426d3ca req-a4436d54-e4b0-48fc-822a-51373b5d9b9d service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-4c06a718-ce09-407e-844a-f3018426d3ca req-a4436d54-e4b0-48fc-822a-51373b5d9b9d service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:52 user nova-compute[75305]: WARNING nova.compute.manager [req-4c06a718-ce09-407e-844a-f3018426d3ca req-a4436d54-e4b0-48fc-822a-51373b5d9b9d service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:13:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance destroyed successfully.
Nov 14 08:13:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:54 user nova-compute[75305]: WARNING nova.compute.manager [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:13:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:54 user nova-compute[75305]: WARNING nova.compute.manager [req-87496805-e679-4d61-a576-9ff65d4b384f req-9ac6c117-3c07-4214-a946-45f73b600691 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:13:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:56 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bfceaf88-ee80-4da6-a60e-d87df501b664 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:13:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bd03d63f-8eb3-4379-a6d8-628e4a0a494d req-c9151d4a-0dd9-40cd-ae84-29a5ebb398f5 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd03d63f-8eb3-4379-a6d8-628e4a0a494d req-c9151d4a-0dd9-40cd-ae84-29a5ebb398f5 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:13:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd03d63f-8eb3-4379-a6d8-628e4a0a494d req-c9151d4a-0dd9-40cd-ae84-29a5ebb398f5 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:13:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd03d63f-8eb3-4379-a6d8-628e4a0a494d req-c9151d4a-0dd9-40cd-ae84-29a5ebb398f5 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:13:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bd03d63f-8eb3-4379-a6d8-628e4a0a494d req-c9151d4a-0dd9-40cd-ae84-29a5ebb398f5 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:13:56 user nova-compute[75305]: WARNING nova.compute.manager [req-bd03d63f-8eb3-4379-a6d8-628e4a0a494d req-c9151d4a-0dd9-40cd-ae84-29a5ebb398f5 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state active and task_state None.
Nov 14 08:13:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:13:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-changed-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:13:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Refreshing instance network info cache due to event network-changed-f93212f5-8c61-4e7b-9041-ebfa201aaaa2. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:13:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] Acquiring lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:13:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] Acquired lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:13:59 user nova-compute[75305]: DEBUG nova.network.neutron [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Refreshing network info cache for port f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG nova.network.neutron [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updated VIF entry in instance network info cache for port f93212f5-8c61-4e7b-9041-ebfa201aaaa2. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG nova.network.neutron [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updating instance_info_cache with network_info: [{"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c108fc4-9911-441c-9cfc-26f9da8f4a01 req-579bd2b4-f67f-467a-89f1-fa70080b0aa4 service nova] Releasing lock "refresh_cache-ba827b89-5258-4f7e-9e5d-eb13f35affd4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:00 user nova-compute[75305]: INFO nova.compute.manager [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Terminating instance
Nov 14 08:14:00 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: INFO nova.compute.manager [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Rebuilding instance
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:14:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Instance destroyed successfully.
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lazy-loading 'resources' on Instance uuid dafc732a-81ec-412e-b237-1b18bd6cb577 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-882073150',display_name='tempest-TestServerVolumeAttachmentScenario-server-882073150',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-882073150',id=23,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCGkr3r5Oc4dgd28ueHBjgE9Jsy38IzL+ajpXk2XpO5gjnqz+i8z+N/c8fnoF/uDbSpS8bo3w3M7fJEzq6q/9BOB95i1FCInOpOoSMiEnPI1s1z4yqSX00NUeVrR5KQhg==',key_name='tempest-keypair-685130155',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:10:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5b5ab92b56141ddae4e993ad5f5367f',ramdisk_id='',reservation_id='r-0sk2xyrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1663990830',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1663990830-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:10:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='204f40785a034dcb8311e8350c5b4ba6',uuid=dafc732a-81ec-412e-b237-1b18bd6cb577,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Converting VIF {"id": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "address": "fa:16:3e:13:9c:4a", "network": {"id": "a878b624-ca2b-451b-8c24-18a429c02cdf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1293879143-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5b5ab92b56141ddae4e993ad5f5367f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ffb3807-5d", "ovs_interfaceid": "6ffb3807-5d0f-4854-8636-f11f27f02f08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:9c:4a,bridge_name='br-int',has_traffic_filtering=True,id=6ffb3807-5d0f-4854-8636-f11f27f02f08,network=Network(a878b624-ca2b-451b-8c24-18a429c02cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ffb3807-5d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG os_vif [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:9c:4a,bridge_name='br-int',has_traffic_filtering=True,id=6ffb3807-5d0f-4854-8636-f11f27f02f08,network=Network(a878b624-ca2b-451b-8c24-18a429c02cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ffb3807-5d') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ffb3807-5d, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a05c112-6907-4042-ab22-7919eca85f0f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:01 user nova-compute[75305]: INFO os_vif [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:9c:4a,bridge_name='br-int',has_traffic_filtering=True,id=6ffb3807-5d0f-4854-8636-f11f27f02f08,network=Network(a878b624-ca2b-451b-8c24-18a429c02cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ffb3807-5d')
Nov 14 08:14:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Deleting instance files /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577_del
Nov 14 08:14:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Deletion of /opt/stack/data/nova/instances/dafc732a-81ec-412e-b237-1b18bd6cb577_del complete
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-1bf9a084-d72e-4451-a006-0f48bb54ac7b req-fc3d09cf-4209-49a1-b258-b96648c3535d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-vif-unplugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1bf9a084-d72e-4451-a006-0f48bb54ac7b req-fc3d09cf-4209-49a1-b258-b96648c3535d service nova] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1bf9a084-d72e-4451-a006-0f48bb54ac7b req-fc3d09cf-4209-49a1-b258-b96648c3535d service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1bf9a084-d72e-4451-a006-0f48bb54ac7b req-fc3d09cf-4209-49a1-b258-b96648c3535d service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-1bf9a084-d72e-4451-a006-0f48bb54ac7b req-fc3d09cf-4209-49a1-b258-b96648c3535d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] No waiting events found dispatching network-vif-unplugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-1bf9a084-d72e-4451-a006-0f48bb54ac7b req-fc3d09cf-4209-49a1-b258-b96648c3535d service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-vif-unplugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:14:01 user nova-compute[75305]: INFO nova.compute.manager [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:14:01 user nova-compute[75305]: INFO nova.compute.claims [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Claim successful on node user
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-11519114-1d40-45be-9462-8be63956e078 req-2f265430-6b9c-4e9a-b743-6118e63c692e service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-unplugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-11519114-1d40-45be-9462-8be63956e078 req-2f265430-6b9c-4e9a-b743-6118e63c692e service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-11519114-1d40-45be-9462-8be63956e078 req-2f265430-6b9c-4e9a-b743-6118e63c692e service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-11519114-1d40-45be-9462-8be63956e078 req-2f265430-6b9c-4e9a-b743-6118e63c692e service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-11519114-1d40-45be-9462-8be63956e078 req-2f265430-6b9c-4e9a-b743-6118e63c692e service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-unplugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:01 user nova-compute[75305]: WARNING nova.compute.manager [req-11519114-1d40-45be-9462-8be63956e078 req-2f265430-6b9c-4e9a-b743-6118e63c692e service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received unexpected event network-vif-unplugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with vm_state active and task_state rebuilding.
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.500s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.compute.claims [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Claim successful on node user
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.policy [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '084e1f8ee4db4391b2d545926f45e659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7be86f7bfa9f4566a035ca96314ac1c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance destroyed successfully.
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance destroyed successfully.
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-722280166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517392847',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSHuOBu4lWTlW7Vctn1xXnnT45BYbFZ8zeCXHYrkzYMRxRFA3Nz9SmGzjNbbgTlWci9ACTz2z5/PYwN7XHX+Hj6DF4ifeWa+fwkxv/lSrOPQjwXf0hJfz0Ul+A3SAl5Dw==',key_name='tempest-keypair-61336421',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='31e24af031694052bb3ea06040959499',ramdisk_id='',reservation_id='r-gam6gp6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196740715',owner_user_name='tempest-ServerActionsV293TestJSON-196740715-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:14:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='192f4325fbea478aadbf131b02bf891e',uuid=ba827b89-5258-4f7e-9e5d-eb13f35affd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converting VIF {"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_vif [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf93212f5-8c, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=708bd2ec-db10-4b84-a374-7e30d358a975) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:02 user nova-compute[75305]: INFO os_vif [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c')
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:02 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Creating image(s)
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39e0e16-9dd6-4f7e-98b5-e5a3d004a4e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:14:02 user nova-compute[75305]: No targets found.
Nov 14 08:14:02 user nova-compute[75305]: iSNS:
Nov 14 08:14:02 user nova-compute[75305]: No targets found.
Nov 14 08:14:02 user nova-compute[75305]: STATIC:
Nov 14 08:14:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:14:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:14:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:02 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:14:02 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:02 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:02 user nova-compute[75305]: FIRMWARE:
Nov 14 08:14:02 user nova-compute[75305]: No targets found.
Nov 14 08:14:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:14:02 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:14:02 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-4b1b5fba-41a8-43f9-98ad-72ffed2cd589 req-7d7299e8-dc35-458e-a200-d869c47f0609 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-vif-deleted-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.compute.manager [req-4b1b5fba-41a8-43f9-98ad-72ffed2cd589 req-7d7299e8-dc35-458e-a200-d869c47f0609 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Neutron deleted interface 6ffb3807-5d0f-4854-8636-f11f27f02f08; detaching it from the instance and deleting it from the info cache
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.network.neutron [req-4b1b5fba-41a8-43f9-98ad-72ffed2cd589 req-7d7299e8-dc35-458e-a200-d869c47f0609 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8ed574-6f8d-4213-b374-959e42a07e00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-4b1b5fba-41a8-43f9-98ad-72ffed2cd589 req-7d7299e8-dc35-458e-a200-d869c47f0609 service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Detach interface failed, port_id=6ffb3807-5d0f-4854-8636-f11f27f02f08, reason: Instance dafc732a-81ec-412e-b237-1b18bd6cb577 could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Took 0.96 seconds to deallocate network for instance.
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bc8f1b-ed37-40dc-83a4-d2dae91be522]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:02 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:02 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:02 user nova-compute[75305]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:02 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542bdcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec052db1-5341-457e-9b79-44209b74bbdf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be6a17f-f943-461f-b753-05efa4e63e1a]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.218s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fe8ed5-0cb8-4d2e-bc63-9957d3bc1c25]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e67833-b9c9-41f3-b039-0fd497c00249]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35124a3-258a-4d55-adf9-43f74f7f49a6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fc66d4-4e57-481b-ab28-497c7063c6b5]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]
Nov 14 08:14:02 user nova-compute[75305]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.
Nov 14 08:14:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.259s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk 1073741824" returned: 0 in 0.074s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d314ad12-7589-4b58-a5c2-67cf7c38181a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.533s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] <== disconnect_volume: return (534ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Deleting instance files /opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4_del
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Deletion of /opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4_del complete
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:14:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.policy [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26ebac86c4d845d5a2d3ebc50d9d919e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae5598d280de473f96c6d0f3500a7a9c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Checking if we can resize image /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:14:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Successfully created port: e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:14:03 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ba827b89-5258-4f7e-9e5d-eb13f35affd4 could not be found.
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:03 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4f51a6-1c78-4a97-8bd6-d031f7220bed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:14:03 user nova-compute[75305]: No targets found.
Nov 14 08:14:03 user nova-compute[75305]: iSNS:
Nov 14 08:14:03 user nova-compute[75305]: No targets found.
Nov 14 08:14:03 user nova-compute[75305]: STATIC:
Nov 14 08:14:03 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:14:03 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:03 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:03 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:14:03 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:03 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:03 user nova-compute[75305]: FIRMWARE:
Nov 14 08:14:03 user nova-compute[75305]: No targets found.
Nov 14 08:14:03 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:14:03 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:14:03 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:14:03 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Creating image(s)
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "/opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "/opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a33dded-d8b1-4c46-9ea5-d4c7451c3f2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a41c50-196f-4cd9-ba74-8612c394420b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:03 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:03 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:03 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:03 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf447be950>, {}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Disconnecting from: [] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.122s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] <== disconnect_volume: return (124ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Cannot resize image /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Ensure instance console log exists: /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.215s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.627s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:03 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Deleted allocations for instance dafc732a-81ec-412e-b237-1b18bd6cb577
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-6e3f0691-a38a-4c3a-8104-d40f627b2f0c req-5ef03d19-b621-404d-9166-a28a5ae071ad service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received event network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e3f0691-a38a-4c3a-8104-d40f627b2f0c req-5ef03d19-b621-404d-9166-a28a5ae071ad service nova] Acquiring lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e3f0691-a38a-4c3a-8104-d40f627b2f0c req-5ef03d19-b621-404d-9166-a28a5ae071ad service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6e3f0691-a38a-4c3a-8104-d40f627b2f0c req-5ef03d19-b621-404d-9166-a28a5ae071ad service nova] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-6e3f0691-a38a-4c3a-8104-d40f627b2f0c req-5ef03d19-b621-404d-9166-a28a5ae071ad service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] No waiting events found dispatching network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:03 user nova-compute[75305]: WARNING nova.compute.manager [req-6e3f0691-a38a-4c3a-8104-d40f627b2f0c req-5ef03d19-b621-404d-9166-a28a5ae071ad service nova] [instance: dafc732a-81ec-412e-b237-1b18bd6cb577] Received unexpected event network-vif-plugged-6ffb3807-5d0f-4854-8636-f11f27f02f08 for instance with vm_state deleted and task_state None.
Nov 14 08:14:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.203s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a2815e3c-aaef-4be2-b125-acf4382b4ab2 tempest-TestServerVolumeAttachmentScenario-1663990830 tempest-TestServerVolumeAttachmentScenario-1663990830-project-member] Lock "dafc732a-81ec-412e-b237-1b18bd6cb577" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.071s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk 1073741824" returned: 0 in 0.077s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Successfully created port: 6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Successfully updated port: e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Cannot resize image /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Ensure instance console log exists: /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-8ce58162-89cd-415f-a0e9-210cb6db8b56 req-c751bf20-2db4-4c88-bf62-2a6f67b9a89d service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8ce58162-89cd-415f-a0e9-210cb6db8b56 req-c751bf20-2db4-4c88-bf62-2a6f67b9a89d service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8ce58162-89cd-415f-a0e9-210cb6db8b56 req-c751bf20-2db4-4c88-bf62-2a6f67b9a89d service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8ce58162-89cd-415f-a0e9-210cb6db8b56 req-c751bf20-2db4-4c88-bf62-2a6f67b9a89d service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-8ce58162-89cd-415f-a0e9-210cb6db8b56 req-c751bf20-2db4-4c88-bf62-2a6f67b9a89d service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:04 user nova-compute[75305]: WARNING nova.compute.manager [req-8ce58162-89cd-415f-a0e9-210cb6db8b56 req-c751bf20-2db4-4c88-bf62-2a6f67b9a89d service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received unexpected event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with vm_state active and task_state rebuilding.
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance network_info: |[{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Start _get_guest_xml network_info=[{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:14:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:14:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1368613915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1368613915',id=31,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbwQrOK1QlSZE6X9q8X1qCTf/gx8bD3GXyvl57doyWYQp50KgqQvUBKaoJz29uESl1iUVmTxK/3HfdjqW8RDxaQT9FjAJKojDLe2G76ZMiK6Z1z6yBB3F3wE5dLjd2D0g==',key_name='tempest-keypair-300441375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-diqu32dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=888926e8-0eea-4900-98cf-968133edcfab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'pci_devices' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:14:04 user nova-compute[75305]:   <uuid>888926e8-0eea-4900-98cf-968133edcfab</uuid>
Nov 14 08:14:04 user nova-compute[75305]:   <name>instance-0000001f</name>
Nov 14 08:14:04 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:14:04 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:14:04 user nova-compute[75305]:   <metadata>
Nov 14 08:14:04 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:14:04 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:14:04 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1368613915</nova:name>
Nov 14 08:14:04 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:14:04</nova:creationTime>
Nov 14 08:14:04 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:14:04 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:14:04 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:14:04 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:14:04 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:14:04 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:14:04 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:14:04 user nova-compute[75305]:       <nova:owner>
Nov 14 08:14:04 user nova-compute[75305]:         <nova:user uuid="084e1f8ee4db4391b2d545926f45e659">tempest-AttachVolumeShelveTestJSON-488426726-project-member</nova:user>
Nov 14 08:14:04 user nova-compute[75305]:         <nova:project uuid="7be86f7bfa9f4566a035ca96314ac1c7">tempest-AttachVolumeShelveTestJSON-488426726</nova:project>
Nov 14 08:14:04 user nova-compute[75305]:       </nova:owner>
Nov 14 08:14:04 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:14:04 user nova-compute[75305]:       <nova:ports>
Nov 14 08:14:04 user nova-compute[75305]:         <nova:port uuid="e0f27b62-3bdf-4058-9311-bd610be6b581">
Nov 14 08:14:04 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 08:14:04 user nova-compute[75305]:         </nova:port>
Nov 14 08:14:04 user nova-compute[75305]:       </nova:ports>
Nov 14 08:14:04 user nova-compute[75305]:     </nova:instance>
Nov 14 08:14:04 user nova-compute[75305]:   </metadata>
Nov 14 08:14:04 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:14:04 user nova-compute[75305]:     <system>
Nov 14 08:14:04 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:14:04 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:14:04 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:14:04 user nova-compute[75305]:       <entry name="serial">888926e8-0eea-4900-98cf-968133edcfab</entry>
Nov 14 08:14:04 user nova-compute[75305]:       <entry name="uuid">888926e8-0eea-4900-98cf-968133edcfab</entry>
Nov 14 08:14:04 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:14:04 user nova-compute[75305]:     </system>
Nov 14 08:14:04 user nova-compute[75305]:   </sysinfo>
Nov 14 08:14:04 user nova-compute[75305]:   <os>
Nov 14 08:14:04 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:14:04 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:14:04 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:14:04 user nova-compute[75305]:   </os>
Nov 14 08:14:04 user nova-compute[75305]:   <features>
Nov 14 08:14:04 user nova-compute[75305]:     <acpi/>
Nov 14 08:14:04 user nova-compute[75305]:     <apic/>
Nov 14 08:14:04 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:14:04 user nova-compute[75305]:   </features>
Nov 14 08:14:04 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:14:04 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:14:04 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:14:04 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:14:04 user nova-compute[75305]:   </clock>
Nov 14 08:14:04 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:14:04 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:14:04 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:14:04 user nova-compute[75305]:   </cpu>
Nov 14 08:14:04 user nova-compute[75305]:   <devices>
Nov 14 08:14:04 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:14:04 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:14:04 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk"/>
Nov 14 08:14:04 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:14:04 user nova-compute[75305]:     </disk>
Nov 14 08:14:04 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:14:04 user nova-compute[75305]:       <mac address="fa:16:3e:a8:5d:54"/>
Nov 14 08:14:04 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:14:04 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:14:04 user nova-compute[75305]:       <target dev="tape0f27b62-3b"/>
Nov 14 08:14:04 user nova-compute[75305]:     </interface>
Nov 14 08:14:04 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:14:04 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/console.log" append="off"/>
Nov 14 08:14:04 user nova-compute[75305]:     </serial>
Nov 14 08:14:04 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:14:04 user nova-compute[75305]:     <video>
Nov 14 08:14:04 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:14:04 user nova-compute[75305]:     </video>
Nov 14 08:14:04 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:14:04 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:14:04 user nova-compute[75305]:     </rng>
Nov 14 08:14:04 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:14:04 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:14:04 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:14:04 user nova-compute[75305]:     </memballoon>
Nov 14 08:14:04 user nova-compute[75305]:   </devices>
Nov 14 08:14:04 user nova-compute[75305]: </domain>
Nov 14 08:14:04 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1368613915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1368613915',id=31,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbwQrOK1QlSZE6X9q8X1qCTf/gx8bD3GXyvl57doyWYQp50KgqQvUBKaoJz29uESl1iUVmTxK/3HfdjqW8RDxaQT9FjAJKojDLe2G76ZMiK6Z1z6yBB3F3wE5dLjd2D0g==',key_name='tempest-keypair-300441375',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-diqu32dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=888926e8-0eea-4900-98cf-968133edcfab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG os_vif [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '898d2f90-57f8-54a3-b87a-4b759c09e73c', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0f27b62-3b, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0f27b62-3b, col_values=(('qos', UUID('36c6ffc3-bae2-468a-a6fb-623b19139a56')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0f27b62-3b, col_values=(('external_ids', {'iface-id': 'e0f27b62-3bdf-4058-9311-bd610be6b581', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:5d:54', 'vm-uuid': '888926e8-0eea-4900-98cf-968133edcfab'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:04 user nova-compute[75305]: INFO os_vif [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b')
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No VIF found with MAC fa:16:3e:a8:5d:54, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Preparing to wait for external event volume-reimaged-0534c23b-a785-482a-843d-659c7093bb4a {{(pid=75305) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Successfully updated port: 6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "refresh_cache-6f7b1470-00b1-46d3-a3b3-7c29d822f166" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquired lock "refresh_cache-6f7b1470-00b1-46d3-a3b3-7c29d822f166" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received event network-changed-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Refreshing instance network info cache due to event network-changed-6dc6555f-7909-4b77-87b9-28797de6f868. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] Acquiring lock "refresh_cache-6f7b1470-00b1-46d3-a3b3-7c29d822f166" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:14:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Updating instance_info_cache with network_info: [{"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Releasing lock "refresh_cache-6f7b1470-00b1-46d3-a3b3-7c29d822f166" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Instance network_info: |[{"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] Acquired lock "refresh_cache-6f7b1470-00b1-46d3-a3b3-7c29d822f166" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Refreshing network info cache for port 6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Start _get_guest_xml network_info=[{"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:14:05 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:14:05 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1003248855',display_name='tempest-VolumesAdminNegativeTest-server-1003248855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1003248855',id=32,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5598d280de473f96c6d0f3500a7a9c',ramdisk_id='',reservation_id='r-qcs9twty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1378224790',owner_user_name='tempest-VolumesAdminNegativeTest-1378224790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:14:03Z,user_data=None,user_id='26ebac86c4d845d5a2d3ebc50d9d919e',uuid=6f7b1470-00b1-46d3-a3b3-7c29d822f166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converting VIF {"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:40:26,bridge_name='br-int',has_traffic_filtering=True,id=6dc6555f-7909-4b77-87b9-28797de6f868,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc6555f-79') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f7b1470-00b1-46d3-a3b3-7c29d822f166 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:14:05 user nova-compute[75305]:   <uuid>6f7b1470-00b1-46d3-a3b3-7c29d822f166</uuid>
Nov 14 08:14:05 user nova-compute[75305]:   <name>instance-00000020</name>
Nov 14 08:14:05 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:14:05 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:14:05 user nova-compute[75305]:   <metadata>
Nov 14 08:14:05 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:14:05 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:14:05 user nova-compute[75305]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1003248855</nova:name>
Nov 14 08:14:05 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:14:05</nova:creationTime>
Nov 14 08:14:05 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:14:05 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:14:05 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:14:05 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:14:05 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:14:05 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:14:05 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:14:05 user nova-compute[75305]:       <nova:owner>
Nov 14 08:14:05 user nova-compute[75305]:         <nova:user uuid="26ebac86c4d845d5a2d3ebc50d9d919e">tempest-VolumesAdminNegativeTest-1378224790-project-member</nova:user>
Nov 14 08:14:05 user nova-compute[75305]:         <nova:project uuid="ae5598d280de473f96c6d0f3500a7a9c">tempest-VolumesAdminNegativeTest-1378224790</nova:project>
Nov 14 08:14:05 user nova-compute[75305]:       </nova:owner>
Nov 14 08:14:05 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:14:05 user nova-compute[75305]:       <nova:ports>
Nov 14 08:14:05 user nova-compute[75305]:         <nova:port uuid="6dc6555f-7909-4b77-87b9-28797de6f868">
Nov 14 08:14:05 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 08:14:05 user nova-compute[75305]:         </nova:port>
Nov 14 08:14:05 user nova-compute[75305]:       </nova:ports>
Nov 14 08:14:05 user nova-compute[75305]:     </nova:instance>
Nov 14 08:14:05 user nova-compute[75305]:   </metadata>
Nov 14 08:14:05 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:14:05 user nova-compute[75305]:     <system>
Nov 14 08:14:05 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:14:05 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:14:05 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:14:05 user nova-compute[75305]:       <entry name="serial">6f7b1470-00b1-46d3-a3b3-7c29d822f166</entry>
Nov 14 08:14:05 user nova-compute[75305]:       <entry name="uuid">6f7b1470-00b1-46d3-a3b3-7c29d822f166</entry>
Nov 14 08:14:05 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:14:05 user nova-compute[75305]:     </system>
Nov 14 08:14:05 user nova-compute[75305]:   </sysinfo>
Nov 14 08:14:05 user nova-compute[75305]:   <os>
Nov 14 08:14:05 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:14:05 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:14:05 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:14:05 user nova-compute[75305]:   </os>
Nov 14 08:14:05 user nova-compute[75305]:   <features>
Nov 14 08:14:05 user nova-compute[75305]:     <acpi/>
Nov 14 08:14:05 user nova-compute[75305]:     <apic/>
Nov 14 08:14:05 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:14:05 user nova-compute[75305]:   </features>
Nov 14 08:14:05 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:14:05 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:14:05 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:14:05 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:14:05 user nova-compute[75305]:   </clock>
Nov 14 08:14:05 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:14:05 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:14:05 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:14:05 user nova-compute[75305]:   </cpu>
Nov 14 08:14:05 user nova-compute[75305]:   <devices>
Nov 14 08:14:05 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:14:05 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:14:05 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk"/>
Nov 14 08:14:05 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:14:05 user nova-compute[75305]:     </disk>
Nov 14 08:14:05 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:14:05 user nova-compute[75305]:       <mac address="fa:16:3e:5e:40:26"/>
Nov 14 08:14:05 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:14:05 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:14:05 user nova-compute[75305]:       <target dev="tap6dc6555f-79"/>
Nov 14 08:14:05 user nova-compute[75305]:     </interface>
Nov 14 08:14:05 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:14:05 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/console.log" append="off"/>
Nov 14 08:14:05 user nova-compute[75305]:     </serial>
Nov 14 08:14:05 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:14:05 user nova-compute[75305]:     <video>
Nov 14 08:14:05 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:14:05 user nova-compute[75305]:     </video>
Nov 14 08:14:05 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:14:05 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:14:05 user nova-compute[75305]:     </rng>
Nov 14 08:14:05 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:14:05 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:14:05 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:14:05 user nova-compute[75305]:     </memballoon>
Nov 14 08:14:05 user nova-compute[75305]:   </devices>
Nov 14 08:14:05 user nova-compute[75305]: </domain>
Nov 14 08:14:05 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1003248855',display_name='tempest-VolumesAdminNegativeTest-server-1003248855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1003248855',id=32,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae5598d280de473f96c6d0f3500a7a9c',ramdisk_id='',reservation_id='r-qcs9twty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1378224790',owner_user_name='tempest-VolumesAdminNegativeTest-1378224790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:14:03Z,user_data=None,user_id='26ebac86c4d845d5a2d3ebc50d9d919e',uuid=6f7b1470-00b1-46d3-a3b3-7c29d822f166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converting VIF {"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:40:26,bridge_name='br-int',has_traffic_filtering=True,id=6dc6555f-7909-4b77-87b9-28797de6f868,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc6555f-79') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG os_vif [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:40:26,bridge_name='br-int',has_traffic_filtering=True,id=6dc6555f-7909-4b77-87b9-28797de6f868,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc6555f-79') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d044e6b-25ee-5dc9-9323-8ecd215fffd4', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dc6555f-79, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6dc6555f-79, col_values=(('qos', UUID('3254e3e8-4946-45c5-9107-10df35da5b78')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6dc6555f-79, col_values=(('external_ids', {'iface-id': '6dc6555f-7909-4b77-87b9-28797de6f868', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:40:26', 'vm-uuid': '6f7b1470-00b1-46d3-a3b3-7c29d822f166'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: INFO os_vif [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:40:26,bridge_name='br-int',has_traffic_filtering=True,id=6dc6555f-7909-4b77-87b9-28797de6f868,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc6555f-79')
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] No VIF found with MAC fa:16:3e:5e:40:26, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing instance network info cache due to event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Updated VIF entry in instance network info cache for port 6dc6555f-7909-4b77-87b9-28797de6f868. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Updating instance_info_cache with network_info: [{"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-546b6c31-b55e-4dd6-bf38-029f754a69b4 req-7f009c83-e41c-4e77-854d-823bbfe010eb service nova] Releasing lock "refresh_cache-6f7b1470-00b1-46d3-a3b3-7c29d822f166" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updated VIF entry in instance network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d3721aa-0103-455e-aa4a-bcd130182655 req-9e53d507-1747-451b-a168-6df9f52cb85f service nova] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:06 user nova-compute[75305]: WARNING nova.compute.manager [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state building and task_state spawning.
Nov 14 08:14:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:06 user nova-compute[75305]: WARNING nova.compute.manager [req-e31d72c3-93ae-44cb-8090-bb0117aa7d19 req-54977b9a-f82f-4d15-aff5-9478dfca44fd service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state building and task_state spawning.
Nov 14 08:14:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8ff55a8-7739-4e3b-8734-bf3a14741dfd req-94278194-8098-4999-90b5-cecb74be217b service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received event network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ff55a8-7739-4e3b-8734-bf3a14741dfd req-94278194-8098-4999-90b5-cecb74be217b service nova] Acquiring lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ff55a8-7739-4e3b-8734-bf3a14741dfd req-94278194-8098-4999-90b5-cecb74be217b service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c8ff55a8-7739-4e3b-8734-bf3a14741dfd req-94278194-8098-4999-90b5-cecb74be217b service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-c8ff55a8-7739-4e3b-8734-bf3a14741dfd req-94278194-8098-4999-90b5-cecb74be217b service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] No waiting events found dispatching network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:07 user nova-compute[75305]: WARNING nova.compute.manager [req-c8ff55a8-7739-4e3b-8734-bf3a14741dfd req-94278194-8098-4999-90b5-cecb74be217b service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received unexpected event network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 for instance with vm_state building and task_state spawning.
Nov 14 08:14:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:14:09 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance spawned successfully.
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: INFO nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Took 6.88 seconds to spawn the instance on the hypervisor.
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:14:09 user nova-compute[75305]: INFO nova.compute.manager [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Took 7.78 seconds to build instance.
Nov 14 08:14:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b80c8899-cf55-411e-aa5c-ce7b5a9c3ded tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.892s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:14:09 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Instance spawned successfully.
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-52f753e5-cf07-4d8b-ab68-0ba3a39155c3 req-0636137c-88fb-4dec-8b40-78eaa89f9a2e service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received event network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-52f753e5-cf07-4d8b-ab68-0ba3a39155c3 req-0636137c-88fb-4dec-8b40-78eaa89f9a2e service nova] Acquiring lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-52f753e5-cf07-4d8b-ab68-0ba3a39155c3 req-0636137c-88fb-4dec-8b40-78eaa89f9a2e service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-52f753e5-cf07-4d8b-ab68-0ba3a39155c3 req-0636137c-88fb-4dec-8b40-78eaa89f9a2e service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-52f753e5-cf07-4d8b-ab68-0ba3a39155c3 req-0636137c-88fb-4dec-8b40-78eaa89f9a2e service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] No waiting events found dispatching network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:09 user nova-compute[75305]: WARNING nova.compute.manager [req-52f753e5-cf07-4d8b-ab68-0ba3a39155c3 req-0636137c-88fb-4dec-8b40-78eaa89f9a2e service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received unexpected event network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 for instance with vm_state building and task_state spawning.
Nov 14 08:14:09 user nova-compute[75305]: INFO nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Took 6.57 seconds to spawn the instance on the hypervisor.
Nov 14 08:14:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:14:09 user nova-compute[75305]: INFO nova.compute.manager [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Took 8.27 seconds to build instance.
Nov 14 08:14:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e51846f1-c521-4d39-b723-28d1ce50c1e9 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.376s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-a09f8f7c-5013-4495-925f-b79960e3a8d1 req-4c09c561-4abc-423a-83e9-108a07296bda service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event volume-reimaged-0534c23b-a785-482a-843d-659c7093bb4a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a09f8f7c-5013-4495-925f-b79960e3a8d1 req-4c09c561-4abc-423a-83e9-108a07296bda service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a09f8f7c-5013-4495-925f-b79960e3a8d1 req-4c09c561-4abc-423a-83e9-108a07296bda service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a09f8f7c-5013-4495-925f-b79960e3a8d1 req-4c09c561-4abc-423a-83e9-108a07296bda service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-a09f8f7c-5013-4495-925f-b79960e3a8d1 req-4c09c561-4abc-423a-83e9-108a07296bda service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Processing event volume-reimaged-0534c23b-a785-482a-843d-659c7093bb4a {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 08:14:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance event wait completed in 12 seconds for volume-reimaged {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:14:16 user nova-compute[75305]: INFO nova.virt.block_device [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Booting with volume 0534c23b-a785-482a-843d-659c7093bb4a at /dev/vda
Nov 14 08:14:17 user nova-compute[75305]: DEBUG os_brick.utils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[db862dee-7579-4816-9c02-b676912d1530]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bedb932-ed8c-46ea-9211-6c0b97b64b6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf29426-dd7c-4edf-8f3d-e6b0fe5994ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e32a1-b478-481e-8f35-5787fa52f636]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:14:17 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:14:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15dd23b-e3c7-4b6d-96e7-57b237ff5f36]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG os_brick.utils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:17 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updating existing volume attachment record: f9a16bf2-f4be-4604-afc1-e423ada9cc96 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:14:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:14:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:14:21 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Creating image(s)
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Ensure instance console log exists: /opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Start _get_guest_xml network_info=[{"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'f9a16bf2-f4be-4604-afc1-e423ada9cc96', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba827b89-5258-4f7e-9e5d-eb13f35affd4', 'attached_at': '', 'detached_at': '', 'volume_id': '0534c23b-a785-482a-843d-659c7093bb4a', 'serial': '0534c23b-a785-482a-843d-659c7093bb4a'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:14:21 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 08:14:21 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lazy-loading 'vcpu_model' on Instance uuid ba827b89-5258-4f7e-9e5d-eb13f35affd4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:21 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:21 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:21 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faca750-e318-47c5-b942-58375797b0fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:14:21 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c4d42c-b468-4e4b-85f6-921af7baace7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a] added
Nov 14 08:14:21 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[61319dc3-4e0e-4c1d-b97b-bf2b07942dee]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dc25e1-65d2-4ddb-a6fb-794577b4d23a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fcbVKIjm {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fcbVKIjm" returned: 0 in 0.042s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32823a1c-4c17-491e-b8b9-d77192fd51ee]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fcbVKIjm'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:21 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eee73c4-7526-46bc-be89-5ca5162ebed6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[221f356c-41b5-424b-8a42-8ff8654f5643]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:22 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:22 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa34ce-4d25-4a86-9686-55945d4880a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]
Nov 14 08:14:22 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.
Nov 14 08:14:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e190cc08-3c3d-47f8-82d5-16e4e3291a67]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:14:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7740MB free_disk=25.091793060302734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db164d9-35c0-4034-8ac4-8868df5bdd2c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:22 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:22 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:22 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:22 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.989s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d70cfc-7780-4fdd-b40b-1e94a5df69f2]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba827b89-5258-4f7e-9e5d-eb13f35affd4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba89d1e7-a713-49c3-bed9-317725c13f1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 961e2d61-c567-4861-974f-7cd205244bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 888926e8-0eea-4900-98cf-968133edcfab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6f7b1470-00b1-46d3-a3b3-7c29d822f166 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:14:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.030s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] <== connect_volume: return (2032ms) {'type': 'block', 'scsi_wwn': '26265303638613766', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265303638613766', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-722280166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517392847',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSHuOBu4lWTlW7Vctn1xXnnT45BYbFZ8zeCXHYrkzYMRxRFA3Nz9SmGzjNbbgTlWci9ACTz2z5/PYwN7XHX+Hj6DF4ifeWa+fwkxv/lSrOPQjwXf0hJfz0Ul+A3SAl5Dw==',key_name='tempest-keypair-61336421',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='31e24af031694052bb3ea06040959499',ramdisk_id='',reservation_id='r-gam6gp6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196740715',owner_user_name='tempest-ServerActionsV293TestJSON-196740715-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='192f4325fbea478aadbf131b02bf891e',uuid=ba827b89-5258-4f7e-9e5d-eb13f35affd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converting VIF {"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:14:23 user nova-compute[75305]:   <uuid>ba827b89-5258-4f7e-9e5d-eb13f35affd4</uuid>
Nov 14 08:14:23 user nova-compute[75305]:   <name>instance-0000001b</name>
Nov 14 08:14:23 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:14:23 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:14:23 user nova-compute[75305]:   <metadata>
Nov 14 08:14:23 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:14:23 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:14:23 user nova-compute[75305]:       <nova:name>tempest-ServerActionsV293TestJSON-server-722280166</nova:name>
Nov 14 08:14:23 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:14:21</nova:creationTime>
Nov 14 08:14:23 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:14:23 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:14:23 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:14:23 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:14:23 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:14:23 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:14:23 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:14:23 user nova-compute[75305]:       <nova:owner>
Nov 14 08:14:23 user nova-compute[75305]:         <nova:user uuid="192f4325fbea478aadbf131b02bf891e">tempest-ServerActionsV293TestJSON-196740715-project-member</nova:user>
Nov 14 08:14:23 user nova-compute[75305]:         <nova:project uuid="31e24af031694052bb3ea06040959499">tempest-ServerActionsV293TestJSON-196740715</nova:project>
Nov 14 08:14:23 user nova-compute[75305]:       </nova:owner>
Nov 14 08:14:23 user nova-compute[75305]:       <nova:ports>
Nov 14 08:14:23 user nova-compute[75305]:         <nova:port uuid="f93212f5-8c61-4e7b-9041-ebfa201aaaa2">
Nov 14 08:14:23 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 08:14:23 user nova-compute[75305]:         </nova:port>
Nov 14 08:14:23 user nova-compute[75305]:       </nova:ports>
Nov 14 08:14:23 user nova-compute[75305]:     </nova:instance>
Nov 14 08:14:23 user nova-compute[75305]:   </metadata>
Nov 14 08:14:23 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:14:23 user nova-compute[75305]:     <system>
Nov 14 08:14:23 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:14:23 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:14:23 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:14:23 user nova-compute[75305]:       <entry name="serial">ba827b89-5258-4f7e-9e5d-eb13f35affd4</entry>
Nov 14 08:14:23 user nova-compute[75305]:       <entry name="uuid">ba827b89-5258-4f7e-9e5d-eb13f35affd4</entry>
Nov 14 08:14:23 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:14:23 user nova-compute[75305]:     </system>
Nov 14 08:14:23 user nova-compute[75305]:   </sysinfo>
Nov 14 08:14:23 user nova-compute[75305]:   <os>
Nov 14 08:14:23 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:14:23 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:14:23 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:14:23 user nova-compute[75305]:   </os>
Nov 14 08:14:23 user nova-compute[75305]:   <features>
Nov 14 08:14:23 user nova-compute[75305]:     <acpi/>
Nov 14 08:14:23 user nova-compute[75305]:     <apic/>
Nov 14 08:14:23 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:14:23 user nova-compute[75305]:   </features>
Nov 14 08:14:23 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:14:23 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:14:23 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:14:23 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:14:23 user nova-compute[75305]:   </clock>
Nov 14 08:14:23 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:14:23 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:14:23 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:14:23 user nova-compute[75305]:   </cpu>
Nov 14 08:14:23 user nova-compute[75305]:   <devices>
Nov 14 08:14:23 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:14:23 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:14:23 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:14:23 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:14:23 user nova-compute[75305]:       <serial>0534c23b-a785-482a-843d-659c7093bb4a</serial>
Nov 14 08:14:23 user nova-compute[75305]:     </disk>
Nov 14 08:14:23 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:14:23 user nova-compute[75305]:       <mac address="fa:16:3e:6a:5d:bd"/>
Nov 14 08:14:23 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:14:23 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:14:23 user nova-compute[75305]:       <target dev="tapf93212f5-8c"/>
Nov 14 08:14:23 user nova-compute[75305]:     </interface>
Nov 14 08:14:23 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:14:23 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4/console.log" append="off"/>
Nov 14 08:14:23 user nova-compute[75305]:     </serial>
Nov 14 08:14:23 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:14:23 user nova-compute[75305]:     <video>
Nov 14 08:14:23 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:14:23 user nova-compute[75305]:     </video>
Nov 14 08:14:23 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:14:23 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:14:23 user nova-compute[75305]:     </rng>
Nov 14 08:14:23 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:14:23 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:14:23 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:14:23 user nova-compute[75305]:     </memballoon>
Nov 14 08:14:23 user nova-compute[75305]:   </devices>
Nov 14 08:14:23 user nova-compute[75305]: </domain>
Nov 14 08:14:23 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-722280166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517392847',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSHuOBu4lWTlW7Vctn1xXnnT45BYbFZ8zeCXHYrkzYMRxRFA3Nz9SmGzjNbbgTlWci9ACTz2z5/PYwN7XHX+Hj6DF4ifeWa+fwkxv/lSrOPQjwXf0hJfz0Ul+A3SAl5Dw==',key_name='tempest-keypair-61336421',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:12:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='31e24af031694052bb3ea06040959499',ramdisk_id='',reservation_id='r-gam6gp6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196740715',owner_user_name='tempest-ServerActionsV293TestJSON-196740715-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='192f4325fbea478aadbf131b02bf891e',uuid=ba827b89-5258-4f7e-9e5d-eb13f35affd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converting VIF {"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG os_vif [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bb928e7-d34c-5ad0-8879-e9cefa27cfd9', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf93212f5-8c, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf93212f5-8c, col_values=(('qos', UUID('67387e84-464f-42bc-b989-3c7c67ef87dc')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf93212f5-8c, col_values=(('external_ids', {'iface-id': 'f93212f5-8c61-4e7b-9041-ebfa201aaaa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:5d:bd', 'vm-uuid': 'ba827b89-5258-4f7e-9e5d-eb13f35affd4'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:23 user nova-compute[75305]: INFO os_vif [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c')
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:14:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] No VIF found with MAC fa:16:3e:6a:5d:bd, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-7947521c-586c-406f-bc4a-2bb8dc6f6890 req-0b9554d3-314a-4e00-959e-4a981713af48 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7947521c-586c-406f-bc4a-2bb8dc6f6890 req-0b9554d3-314a-4e00-959e-4a981713af48 service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7947521c-586c-406f-bc4a-2bb8dc6f6890 req-0b9554d3-314a-4e00-959e-4a981713af48 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7947521c-586c-406f-bc4a-2bb8dc6f6890 req-0b9554d3-314a-4e00-959e-4a981713af48 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-7947521c-586c-406f-bc4a-2bb8dc6f6890 req-0b9554d3-314a-4e00-959e-4a981713af48 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:25 user nova-compute[75305]: WARNING nova.compute.manager [req-7947521c-586c-406f-bc4a-2bb8dc6f6890 req-0b9554d3-314a-4e00-959e-4a981713af48 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received unexpected event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 08:14:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:14:26 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:14:27 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance spawned successfully.
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75305) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-08c889d0-7958-496b-a1c8-3945ad036946 req-0b428390-af5f-4db4-bd3d-4af682240620 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-08c889d0-7958-496b-a1c8-3945ad036946 req-0b428390-af5f-4db4-bd3d-4af682240620 service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-08c889d0-7958-496b-a1c8-3945ad036946 req-0b428390-af5f-4db4-bd3d-4af682240620 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-08c889d0-7958-496b-a1c8-3945ad036946 req-0b428390-af5f-4db4-bd3d-4af682240620 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-08c889d0-7958-496b-a1c8-3945ad036946 req-0b428390-af5f-4db4-bd3d-4af682240620 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:14:27 user nova-compute[75305]: WARNING nova.compute.manager [req-08c889d0-7958-496b-a1c8-3945ad036946 req-0b428390-af5f-4db4-bd3d-4af682240620 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received unexpected event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with vm_state active and task_state None.
Nov 14 08:14:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a09f8f7c-5013-4495-925f-b79960e3a8d1 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.078s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-changed-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:14:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Refreshing instance network info cache due to event network-changed-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:14:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] Acquiring lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:14:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] Acquired lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:14:29 user nova-compute[75305]: DEBUG nova.network.neutron [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Refreshing network info cache for port 08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG nova.network.neutron [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Updated VIF entry in instance network info cache for port 08c62ea5-1270-4cf2-9f5f-38fa6e8038a7. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG nova.network.neutron [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Updating instance_info_cache with network_info: [{"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-11ebae29-78a9-4c77-8414-b89d24760d20 req-347ec1cb-78c7-4c4d-869b-c12652e803e9 service nova] Releasing lock "refresh_cache-a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG nova.objects.instance [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.366s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:30 user nova-compute[75305]: INFO nova.compute.manager [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Attaching volume c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 to /dev/vdb
Nov 14 08:14:30 user nova-compute[75305]: DEBUG os_brick.utils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[750da66f-0168-4b78-aa49-5446abd051d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0713ce6b-0525-4b2e-8dbb-f7f70c3bae61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f50bd5-83f7-4f92-a220-9ec729a5c7e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dac5d53-d38c-44af-8680-e129c2a386bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:14:30 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:14:30 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2fa585-87ea-4154-adaf-bbb38cb2db1a]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG os_brick.utils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:30 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Updating existing volume attachment record: 6007eeeb-e592-4345-a4f1-c121925eaf63 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:14:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzfUmiJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:35 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:35 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:35 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a137f983-2fef-4365-bcda-dacab402ad22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:14:35 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a44c3b-4245-4963-8927-b4853a07eb20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1] added
Nov 14 08:14:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[465a88ff-1662-45cb-8b1a-afd6c47f2eec]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7fa2f-52ea-4a34-8fc5-c640e15759ac]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzfUmiJn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YzfUmiJn" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d4d9d-f4f1-4089-a632-a4d20eeb7fe5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YzfUmiJn'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4877ac-b2a0-485b-b20b-db5409ae6e5c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af503a03-e951-4775-baba-258b9b48b641]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc05cdf-4c3c-471c-8dce-a9a4a4f25b93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260]
Nov 14 08:14:35 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260] successful.
Nov 14 08:14:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8016df19-dd89-4766-b9e4-e0de90723657]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f78eb-c204-4678-bdc0-9f0c41f79eaf]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:35 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89afeea3-7897-4aa7-a59f-91552e90f7e4]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:14:36 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:14:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzfUmiJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:14:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23663623836636638', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663623836636638', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:14:36 user nova-compute[75305]: DEBUG nova.objects.instance [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:14:36 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:14:36 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:14:36 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:14:36 user nova-compute[75305]:   <serial>c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1</serial>
Nov 14 08:14:36 user nova-compute[75305]: </disk>
Nov 14 08:14:36 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:14:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:14:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:14:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] No VIF found with MAC fa:16:3e:b3:4d:8f, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:14:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-13a7e179-27ae-407d-8ca7-d1bd9c4b3a03 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.550s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:38 user nova-compute[75305]: INFO nova.compute.manager [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Detaching volume c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1
Nov 14 08:14:38 user nova-compute[75305]: INFO nova.virt.block_device [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Attempting to driver detach volume c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 from mountpoint /dev/vdb
Nov 14 08:14:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Attempting to detach device vdb from instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:14:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:14:38 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:14:38 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:14:38 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:14:38 user nova-compute[75305]:   <serial>c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1</serial>
Nov 14 08:14:38 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:14:38 user nova-compute[75305]: </disk>
Nov 14 08:14:38 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:14:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully detached device vdb from instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 from the persistent domain config.
Nov 14 08:14:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:14:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:14:38 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:14:38 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:14:38 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:14:38 user nova-compute[75305]:   <serial>c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1</serial>
Nov 14 08:14:38 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:14:38 user nova-compute[75305]: </disk>
Nov 14 08:14:38 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:14:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:14:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG nova.objects.instance [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'flavor' on Instance uuid ba89d1e7-a713-49c3-bed9-317725c13f1c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:14:51 user nova-compute[75305]: INFO nova.compute.manager [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Attaching volume 2f8a4760-4834-4861-bc58-ba917f484ae8 to /dev/vdb
Nov 14 08:14:51 user nova-compute[75305]: DEBUG os_brick.utils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbab299-229c-4e55-ac91-4e9cab248c9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f76a336-5dc9-401e-8dbd-64f0788416a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d329d-cab5-4bea-9bbf-67f13a50626a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[711e738f-e54c-4bbf-b18d-84f00c52c70f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:14:51 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:14:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ee4061-a451-467d-b06f-5266339bb5c1]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG os_brick.utils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:51 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating existing volume attachment record: 69c7f6b4-e519-425e-b450-b7ebe78dba39 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:14:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDVFINYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:56 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:56 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:56 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92a2cb5-22eb-4373-8eff-bc04232d6bff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:14:56 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1a6d7b-1146-4386-ba16-eac10ba06c08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8] added
Nov 14 08:14:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84cf898-b915-4051-837b-6e815ebdfe62]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3c8894-c08d-4bdd-87c7-b8f9ccc7b0c0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDVFINYL {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UDVFINYL" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04343329-576a-484e-a355-dd40d8bdb7c7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UDVFINYL'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dfe85a-ba8c-4640-a572-f4d17cc1eebf]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7b828b-0b9d-4bb7-8bc9-537ba0578949]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d0974b-d079-49d7-83cf-3a689b6ac0f5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260]
Nov 14 08:14:56 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260] successful.
Nov 14 08:14:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf31966-32df-4166-920c-bd39cbe5f978]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[162cfcd3-3fea-4ccf-a003-a7ccd06ef5a5]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:14:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69593e-8d03-458f-8cd1-f5bac201d9f5]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:14:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDVFINYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23938626230343937', 'path': '/dev/sdf'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938626230343937', 'path': '/dev/sdf'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'flavor' on Instance uuid ba89d1e7-a713-49c3-bed9-317725c13f1c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:14:57 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:14:57 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:14:57 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:14:57 user nova-compute[75305]:   <serial>2f8a4760-4834-4861-bc58-ba917f484ae8</serial>
Nov 14 08:14:57 user nova-compute[75305]: </disk>
Nov 14 08:14:57 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] No VIF found with MAC fa:16:3e:5a:24:8d, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:14:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-590a8c9c-e3a0-4b58-ae02-00bfaa37a02c tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.567s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:14:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:14:59 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 is timed out.
Nov 14 08:14:59 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully detached device vdb from instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 from the live domain config.
Nov 14 08:14:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YzfUmiJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:14:59 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc14106-f438-43d1-9778-1588dc9fac86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:14:59 user nova-compute[75305]: No targets found.
Nov 14 08:14:59 user nova-compute[75305]: iSNS:
Nov 14 08:14:59 user nova-compute[75305]: No targets found.
Nov 14 08:14:59 user nova-compute[75305]: STATIC:
Nov 14 08:14:59 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1
Nov 14 08:14:59 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:59 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:59 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:14:59 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:59 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:59 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8
Nov 14 08:14:59 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:59 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:59 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:14:59 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:59 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:59 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:14:59 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:14:59 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:14:59 user nova-compute[75305]: FIRMWARE:
Nov 14 08:14:59 user nova-compute[75305]: No targets found.
Nov 14 08:14:59 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:14:59 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:14:59 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b94d478-230c-44b5-9fb7-f3a7ba75f7f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15e340d-9453-45b2-9281-fee4a1c4f8b6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:14:59 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 (non-flash)
Nov 14 08:14:59 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:14:59 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542a9f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aac1c8b-90af-4976-a848-41b52243fe0e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d364dc-1f70-489e-b7f7-378cdf0837f4]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe82499-254d-474c-8572-0dd23ef23838]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[699ed8fd-7e08-4a4c-965a-8bbb1a3f1c44]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efb2e6b-54a3-470e-a532-1de85905620c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e402ab-b1b7-4d19-b685-c372f4912d3e]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260]
Nov 14 08:14:59 user nova-compute[75305]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1, portal: 172.16.0.220,3260] successful.
Nov 14 08:14:59 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c25f1fb1-82a7-4ad1-9bf8-2478f49b37d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7620538b-cc08-458e-a529-3b612d435aed]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] <== disconnect_volume: return (333ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:14:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:15:00 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'flavor' on Instance uuid a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:15:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f78a6c7e-ce78-4f56-bb08-0c397e756264 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing instance network info cache due to event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updated VIF entry in instance network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fcd300a-694d-44c2-a1e5-263fb60a7d02 req-8cf8a4e6-8a91-4776-9efe-4d85d76c5bb0 service nova] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing instance network info cache due to event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:03 user nova-compute[75305]: INFO nova.compute.manager [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Rebooting instance
Nov 14 08:15:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updated VIF entry in instance network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3dc7d843-3fc0-4e90-9d05-2ef13746fabb req-62e73667-9865-4ab4-873b-e6294e39bf9e service nova] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:15:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-ff0ca642-eb38-4ef4-bf75-7ebee6681001 req-521ab84e-3696-4e1c-a8b3-94a76faeb099 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff0ca642-eb38-4ef4-bf75-7ebee6681001 req-521ab84e-3696-4e1c-a8b3-94a76faeb099 service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff0ca642-eb38-4ef4-bf75-7ebee6681001 req-521ab84e-3696-4e1c-a8b3-94a76faeb099 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ff0ca642-eb38-4ef4-bf75-7ebee6681001 req-521ab84e-3696-4e1c-a8b3-94a76faeb099 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-ff0ca642-eb38-4ef4-bf75-7ebee6681001 req-521ab84e-3696-4e1c-a8b3-94a76faeb099 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:06 user nova-compute[75305]: WARNING nova.compute.manager [req-ff0ca642-eb38-4ef4-bf75-7ebee6681001 req-521ab84e-3696-4e1c-a8b3-94a76faeb099 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance shutdown successfully.
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:08 user nova-compute[75305]: WARNING nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:08 user nova-compute[75305]: WARNING nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:08 user nova-compute[75305]: WARNING nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:08 user nova-compute[75305]: WARNING nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:08 user nova-compute[75305]: WARNING nova.compute.manager [req-0541330c-47bb-4159-bb7a-815d40a9fb73 req-ebcfffd6-a339-4a0f-9256-4b2ea666feca service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:10 user nova-compute[75305]: WARNING nova.compute.manager [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:10 user nova-compute[75305]: WARNING nova.compute.manager [req-2d2faf90-c090-4bcf-a073-ea9579ea0326 req-f67421c8-ffc9-4357-a5ac-aa6ab1694ea3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state active and task_state reboot_started.
Nov 14 08:15:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance running successfully.
Nov 14 08:15:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance soft rebooted successfully.
Nov 14 08:15:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:15:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-32d73f82-30d3-4933-8028-b98e41a0deb3 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.240s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:15:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:15:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:15:22 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7536MB free_disk=25.023319244384766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba827b89-5258-4f7e-9e5d-eb13f35affd4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba89d1e7-a713-49c3-bed9-317725c13f1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 961e2d61-c567-4861-974f-7cd205244bee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 888926e8-0eea-4900-98cf-968133edcfab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 6f7b1470-00b1-46d3-a3b3-7c29d822f166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:15:22 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:15:23 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:15:23 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:15:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:15:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.600s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:27 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updating instance_info_cache with network_info: [{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:28 user nova-compute[75305]: INFO nova.compute.manager [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Terminating instance
Nov 14 08:15:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-07f1e9c5-541a-4659-b05e-29837421b262 req-cf4d8de7-1cea-48da-9715-105221bf7179 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-vif-unplugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-07f1e9c5-541a-4659-b05e-29837421b262 req-cf4d8de7-1cea-48da-9715-105221bf7179 service nova] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-07f1e9c5-541a-4659-b05e-29837421b262 req-cf4d8de7-1cea-48da-9715-105221bf7179 service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-07f1e9c5-541a-4659-b05e-29837421b262 req-cf4d8de7-1cea-48da-9715-105221bf7179 service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-07f1e9c5-541a-4659-b05e-29837421b262 req-cf4d8de7-1cea-48da-9715-105221bf7179 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] No waiting events found dispatching network-vif-unplugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-07f1e9c5-541a-4659-b05e-29837421b262 req-cf4d8de7-1cea-48da-9715-105221bf7179 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-vif-unplugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:15:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Instance destroyed successfully.
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lazy-loading 'resources' on Instance uuid a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1561045193',display_name='tempest-AttachVolumeNegativeTest-server-1561045193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1561045193',id=28,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG1jzxa/1vxKhZR3lbOEmitgAhR0BPJTzGhuNasIg99EMi6gkFPdfXyjDWlrl1QsYmXFU59UbVkjZ0IZvuB4eqfbF51fROIBNBmUhVRbF3axpHk0ewnIGsXIJDIYapOyA==',key_name='tempest-keypair-1371442622',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:12:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aeba260be7f045959c391eb65633be89',ramdisk_id='',reservation_id='r-v3dxhimr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1514251643',owner_user_name='tempest-AttachVolumeNegativeTest-1514251643-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:12:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6921b8792c4b4f098ee61c6d8bc840c9',uuid=a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converting VIF {"id": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "address": "fa:16:3e:b3:4d:8f", "network": {"id": "282e4263-8bfe-4ab1-91b8-388095b1dacf", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1485657995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aeba260be7f045959c391eb65633be89", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c62ea5-12", "ovs_interfaceid": "08c62ea5-1270-4cf2-9f5f-38fa6e8038a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:4d:8f,bridge_name='br-int',has_traffic_filtering=True,id=08c62ea5-1270-4cf2-9f5f-38fa6e8038a7,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c62ea5-12') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG os_vif [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:4d:8f,bridge_name='br-int',has_traffic_filtering=True,id=08c62ea5-1270-4cf2-9f5f-38fa6e8038a7,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c62ea5-12') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08c62ea5-12, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3f53109-3085-4bb6-86ed-04959ae6b535) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:29 user nova-compute[75305]: INFO os_vif [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:4d:8f,bridge_name='br-int',has_traffic_filtering=True,id=08c62ea5-1270-4cf2-9f5f-38fa6e8038a7,network=Network(282e4263-8bfe-4ab1-91b8-388095b1dacf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c62ea5-12')
Nov 14 08:15:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Deleting instance files /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0_del
Nov 14 08:15:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Deletion of /opt/stack/data/nova/instances/a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0_del complete
Nov 14 08:15:29 user nova-compute[75305]: INFO nova.compute.manager [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 08:15:29 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:15:29 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:15:30 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:30 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Took 0.97 seconds to deallocate network for instance.
Nov 14 08:15:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:31 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Deleted allocations for instance a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c7e783af-3712-4f06-aaac-6d9287a65ff3 tempest-AttachVolumeNegativeTest-1514251643 tempest-AttachVolumeNegativeTest-1514251643-project-member] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.293s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] Acquiring lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] Lock "a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] No waiting events found dispatching network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:31 user nova-compute[75305]: WARNING nova.compute.manager [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received unexpected event network-vif-plugged-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 for instance with vm_state deleted and task_state None.
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: a8e3d94c-2dc8-4db9-a6b3-0d9d54ce36a0] Received event network-vif-deleted-08c62ea5-1270-4cf2-9f5f-38fa6e8038a7 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-changed-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Refreshing instance network info cache due to event network-changed-a89876c5-db54-4173-ae04-a88c966b86b5. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] Acquiring lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] Acquired lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Refreshing network info cache for port a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updated VIF entry in instance network info cache for port a89876c5-db54-4173-ae04-a88c966b86b5. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [{"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4bc5432-6012-4634-b0c1-8157acff54b4 req-bc3aae1b-c41e-4b77-bba8-0d5212f2ed60 service nova] Releasing lock "refresh_cache-9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:32 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Stashing vm_state: active {{(pid=75305) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 08:15:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:32 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:15:32 user nova-compute[75305]: INFO nova.compute.claims [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Claim successful on node user
Nov 14 08:15:33 user nova-compute[75305]: INFO nova.compute.resource_tracker [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating resource usage from migration f5aeda3f-0457-4a18-98d4-336462241a2a
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-changed-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Refreshing instance network info cache due to event network-changed-a93393fb-68b8-4ff0-a390-517a385f6c92. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] Acquiring lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] Acquired lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.network.neutron [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Refreshing network info cache for port a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.435s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:33 user nova-compute[75305]: INFO nova.compute.manager [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Migrating
Nov 14 08:15:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.network.neutron [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updated VIF entry in instance network info cache for port a93393fb-68b8-4ff0-a390-517a385f6c92. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.network.neutron [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c9fe2234-2b00-41c5-b3dd-00637d83a243 req-1446f529-30b4-468f-9365-c8ffa9ece98f service nova] Releasing lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquired lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:15:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Releasing lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Starting migrate_disk_and_power_off {{(pid=75305) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 08:15:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:35 user nova-compute[75305]: WARNING nova.compute.manager [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state active and task_state resize_migrating.
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:35 user nova-compute[75305]: WARNING nova.compute.manager [req-d11608e3-63b7-4f40-85c4-ee40e716cc86 req-6829cd31-4722-400b-ad33-7dbb5fd366bf service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state active and task_state resize_migrating.
Nov 14 08:15:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance destroyed successfully.
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1141013763',display_name='tempest-ServerActionsTestOtherA-server-1141013763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1141013763',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:13:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-37g09cai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:15:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=961e2d61-c567-4861-974f-7cd205244bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-239072767-network", "vif_mac": "fa:16:3e:00:13:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-239072767-network", "vif_mac": "fa:16:3e:00:13:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_vif [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa93393fb-68, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85dcb478-ffe3-425b-92b4-1d21921c3530) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:35 user nova-compute[75305]: INFO os_vif [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68')
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:15:35 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f199221b-a6c0-40ab-9a57-acb28b5d7cfe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:15:35 user nova-compute[75305]: No targets found.
Nov 14 08:15:35 user nova-compute[75305]: iSNS:
Nov 14 08:15:35 user nova-compute[75305]: No targets found.
Nov 14 08:15:35 user nova-compute[75305]: STATIC:
Nov 14 08:15:35 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:15:35 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:35 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:35 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8
Nov 14 08:15:35 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:35 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:35 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:15:35 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:35 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:35 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:15:35 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:35 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:35 user nova-compute[75305]: FIRMWARE:
Nov 14 08:15:35 user nova-compute[75305]: No targets found.
Nov 14 08:15:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:15:35 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:15:35 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c8ee9e-9a88-4076-81d0-5f3b8729f990]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab03fef-12e1-439a-880a-c7d3370629d0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:35 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:15:35 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:35 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:35 user nova-compute[75305]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:15:35 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:35 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442c0e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a64d5ff-68ef-418f-bd07-a7fa559e4676]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1805fe39-ae4e-403c-a429-dc35b11611a1]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd6ced-5e0e-461e-ab93-d413c4bb3185]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7084a1-aa70-42d8-9bb7-6510dae3d6b4]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26133663563323636', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f071333d', '/dev/disk/by-id/scsi-1SCST_BIOf071333d-a3f5c26632740082') {{(pid=86224) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[da61d0fa-2993-4b76-9f6e-16111e1ca64b]: (4, None) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9497f8e7-f6ca-46db-8ed0-53719ec22b30]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b870af6-92ef-4cc8-b62f-8aca13627a45]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]
Nov 14 08:15:35 user nova-compute[75305]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.
Nov 14 08:15:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a394be23-f263-485e-a211-a589c69d93ef]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== disconnect_volume: return (320ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:15:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:15:36 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Port a93393fb-68b8-4ff0-a390-517a385f6c92 binding to destination host user is already ACTIVE {{(pid=75305) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquired lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Releasing lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG os_brick.utils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf81f318-105d-4ec4-a257-db11f774d702]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef73c704-ad0f-4c82-845a-04f1a27eea91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d339ea42-34ea-4ba0-91cd-040b782906ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9706111f-90fa-4d99-91f2-c567cc2f9f3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:15:37 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:15:37 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8184f9-23de-4576-8d82-479b520e0810]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:15:37 user nova-compute[75305]: DEBUG os_brick.utils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:15:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Starting finish_migration {{(pid=75305) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:15:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Creating image(s)
Nov 14 08:15:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Ensure instance console log exists: /opt/stack/data/nova/instances/961e2d61-c567-4861-974f-7cd205244bee/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Start _get_guest_xml network_info=[{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-239072767-network", "vif_mac": "fa:16:3e:00:13:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'fb31816a-e059-4a21-8ed8-f10a64f88229', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '961e2d61-c567-4861-974f-7cd205244bee', 'attached_at': '2023-11-14T08:15:42.000000', 'detached_at': '', 'volume_id': 'b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'serial': 'b9f10f8c-67dd-4327-b9d9-13d80279f96b'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:15:41 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:15:41 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:15:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:15:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:15:42 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:15:42 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:15:42 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d04f85-e3ea-443e-87c7-bf8aacf2892a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:15:42 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba7140-8e13-407b-ad61-a3ce7fec995b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b] added
Nov 14 08:15:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f985f3be-df2b-45ee-a83a-607ff9be7e2d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32748bae-b9bb-4f37-ac6e-aaba2c776adf]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvZTPxIK {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wvZTPxIK" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f94c448-e776-41b1-94b8-37f670701d90]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wvZTPxIK'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4776ba67-6898-4ffd-a220-aeba37ad49c3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18867eaa-c6f3-46c7-87bb-f42b1ae40873]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e2883-76ac-4aa4-9dd1-6a29351d73dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]
Nov 14 08:15:42 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.
Nov 14 08:15:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef3ee0-2f0f-4f13-8c89-0ecdca165c92]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ae078-d0e9-4222-ad28-6f6b3dccc356]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:15:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:42 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:15:42 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ddd4b-a114-41f0-92d9-1f12128bd1df]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26133663563323636', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133663563323636', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1141013763',display_name='tempest-ServerActionsTestOtherA-server-1141013763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1141013763',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:13:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-37g09cai',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=961e2d61-c567-4861-974f-7cd205244bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-239072767-network", "vif_mac": "fa:16:3e:00:13:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-239072767-network", "vif_mac": "fa:16:3e:00:13:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:15:43 user nova-compute[75305]:   <uuid>961e2d61-c567-4861-974f-7cd205244bee</uuid>
Nov 14 08:15:43 user nova-compute[75305]:   <name>instance-0000001e</name>
Nov 14 08:15:43 user nova-compute[75305]:   <memory>2097152</memory>
Nov 14 08:15:43 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:15:43 user nova-compute[75305]:   <metadata>
Nov 14 08:15:43 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:15:43 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:15:43 user nova-compute[75305]:       <nova:name>tempest-ServerActionsTestOtherA-server-1141013763</nova:name>
Nov 14 08:15:43 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:15:41</nova:creationTime>
Nov 14 08:15:43 user nova-compute[75305]:       <nova:flavor name="m1.small">
Nov 14 08:15:43 user nova-compute[75305]:         <nova:memory>2048</nova:memory>
Nov 14 08:15:43 user nova-compute[75305]:         <nova:disk>20</nova:disk>
Nov 14 08:15:43 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:15:43 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:15:43 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:15:43 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:15:43 user nova-compute[75305]:       <nova:owner>
Nov 14 08:15:43 user nova-compute[75305]:         <nova:user uuid="574c9a82a4994bdcb60c5d96b199d69a">tempest-ServerActionsTestOtherA-723782501-project-member</nova:user>
Nov 14 08:15:43 user nova-compute[75305]:         <nova:project uuid="34a93139587f4dc0b2bd586961056c6c">tempest-ServerActionsTestOtherA-723782501</nova:project>
Nov 14 08:15:43 user nova-compute[75305]:       </nova:owner>
Nov 14 08:15:43 user nova-compute[75305]:       <nova:ports>
Nov 14 08:15:43 user nova-compute[75305]:         <nova:port uuid="a93393fb-68b8-4ff0-a390-517a385f6c92">
Nov 14 08:15:43 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:15:43 user nova-compute[75305]:         </nova:port>
Nov 14 08:15:43 user nova-compute[75305]:       </nova:ports>
Nov 14 08:15:43 user nova-compute[75305]:     </nova:instance>
Nov 14 08:15:43 user nova-compute[75305]:   </metadata>
Nov 14 08:15:43 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:15:43 user nova-compute[75305]:     <system>
Nov 14 08:15:43 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:15:43 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:15:43 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:15:43 user nova-compute[75305]:       <entry name="serial">961e2d61-c567-4861-974f-7cd205244bee</entry>
Nov 14 08:15:43 user nova-compute[75305]:       <entry name="uuid">961e2d61-c567-4861-974f-7cd205244bee</entry>
Nov 14 08:15:43 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:15:43 user nova-compute[75305]:     </system>
Nov 14 08:15:43 user nova-compute[75305]:   </sysinfo>
Nov 14 08:15:43 user nova-compute[75305]:   <os>
Nov 14 08:15:43 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:15:43 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:15:43 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:15:43 user nova-compute[75305]:   </os>
Nov 14 08:15:43 user nova-compute[75305]:   <features>
Nov 14 08:15:43 user nova-compute[75305]:     <acpi/>
Nov 14 08:15:43 user nova-compute[75305]:     <apic/>
Nov 14 08:15:43 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:15:43 user nova-compute[75305]:   </features>
Nov 14 08:15:43 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:15:43 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:15:43 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:15:43 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:15:43 user nova-compute[75305]:   </clock>
Nov 14 08:15:43 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:15:43 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:15:43 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:15:43 user nova-compute[75305]:   </cpu>
Nov 14 08:15:43 user nova-compute[75305]:   <devices>
Nov 14 08:15:43 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:15:43 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:15:43 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:15:43 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:15:43 user nova-compute[75305]:       <serial>b9f10f8c-67dd-4327-b9d9-13d80279f96b</serial>
Nov 14 08:15:43 user nova-compute[75305]:     </disk>
Nov 14 08:15:43 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:15:43 user nova-compute[75305]:       <mac address="fa:16:3e:00:13:cc"/>
Nov 14 08:15:43 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:15:43 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:15:43 user nova-compute[75305]:       <target dev="tapa93393fb-68"/>
Nov 14 08:15:43 user nova-compute[75305]:     </interface>
Nov 14 08:15:43 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:15:43 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/961e2d61-c567-4861-974f-7cd205244bee/console.log" append="off"/>
Nov 14 08:15:43 user nova-compute[75305]:     </serial>
Nov 14 08:15:43 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:15:43 user nova-compute[75305]:     <video>
Nov 14 08:15:43 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:15:43 user nova-compute[75305]:     </video>
Nov 14 08:15:43 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:15:43 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:15:43 user nova-compute[75305]:     </rng>
Nov 14 08:15:43 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:15:43 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:15:43 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:15:43 user nova-compute[75305]:     </memballoon>
Nov 14 08:15:43 user nova-compute[75305]:   </devices>
Nov 14 08:15:43 user nova-compute[75305]: </domain>
Nov 14 08:15:43 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1141013763',display_name='tempest-ServerActionsTestOtherA-server-1141013763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1141013763',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:13:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-37g09cai',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=961e2d61-c567-4861-974f-7cd205244bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-239072767-network", "vif_mac": "fa:16:3e:00:13:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-239072767-network", "vif_mac": "fa:16:3e:00:13:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG os_vif [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40513ca0-33f0-5d0f-93ca-399f4d3a8ba4', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa93393fb-68, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa93393fb-68, col_values=(('qos', UUID('a38e79ee-38b8-4ff7-99bf-1194aedab3f0')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa93393fb-68, col_values=(('external_ids', {'iface-id': 'a93393fb-68b8-4ff0-a390-517a385f6c92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:13:cc', 'vm-uuid': '961e2d61-c567-4861-974f-7cd205244bee'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:43 user nova-compute[75305]: INFO os_vif [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68')
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] No VIF found with MAC fa:16:3e:00:13:cc, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:15:43 user nova-compute[75305]: INFO nova.compute.claims [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Claim successful on node user
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:15:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.policy [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74b6bdb955524015ad1aec74ee466957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92869b8c2e246ca8f9d361c8ecabac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:15:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Creating image(s)
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "/opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk 1073741824" returned: 0 in 0.054s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-416c0a80-5922-4640-8d98-36c070631b2c req-3c771a06-e08b-406f-9b9a-9b120585fd8f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-416c0a80-5922-4640-8d98-36c070631b2c req-3c771a06-e08b-406f-9b9a-9b120585fd8f service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-416c0a80-5922-4640-8d98-36c070631b2c req-3c771a06-e08b-406f-9b9a-9b120585fd8f service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-416c0a80-5922-4640-8d98-36c070631b2c req-3c771a06-e08b-406f-9b9a-9b120585fd8f service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-416c0a80-5922-4640-8d98-36c070631b2c req-3c771a06-e08b-406f-9b9a-9b120585fd8f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:45 user nova-compute[75305]: WARNING nova.compute.manager [req-416c0a80-5922-4640-8d98-36c070631b2c req-3c771a06-e08b-406f-9b9a-9b120585fd8f service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state active and task_state resize_finish.
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Cannot resize image /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Ensure instance console log exists: /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Successfully created port: 27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Successfully updated port: 27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Updating instance_info_cache with network_info: [{"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Instance network_info: |[{"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Start _get_guest_xml network_info=[{"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:15:46 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:15:46 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063802549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063802549',id=33,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-ohrpq3zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:15:44Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=36cc9bba-70f0-4bcd-bf54-81cfd335f797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a6:86,bridge_name='br-int',has_traffic_filtering=True,id=27a201cb-868c-4357-a4f1-f4b27046b4cf,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a201cb-86') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.objects.instance [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'pci_devices' on Instance uuid 36cc9bba-70f0-4bcd-bf54-81cfd335f797 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:15:46 user nova-compute[75305]:   <uuid>36cc9bba-70f0-4bcd-bf54-81cfd335f797</uuid>
Nov 14 08:15:46 user nova-compute[75305]:   <name>instance-00000021</name>
Nov 14 08:15:46 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:15:46 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:15:46 user nova-compute[75305]:   <metadata>
Nov 14 08:15:46 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:15:46 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:15:46 user nova-compute[75305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2063802549</nova:name>
Nov 14 08:15:46 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:15:46</nova:creationTime>
Nov 14 08:15:46 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:15:46 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:15:46 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:15:46 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:15:46 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:15:46 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:15:46 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:15:46 user nova-compute[75305]:       <nova:owner>
Nov 14 08:15:46 user nova-compute[75305]:         <nova:user uuid="74b6bdb955524015ad1aec74ee466957">tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member</nova:user>
Nov 14 08:15:46 user nova-compute[75305]:         <nova:project uuid="f92869b8c2e246ca8f9d361c8ecabac0">tempest-ServerBootFromVolumeStableRescueTest-983718269</nova:project>
Nov 14 08:15:46 user nova-compute[75305]:       </nova:owner>
Nov 14 08:15:46 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:15:46 user nova-compute[75305]:       <nova:ports>
Nov 14 08:15:46 user nova-compute[75305]:         <nova:port uuid="27a201cb-868c-4357-a4f1-f4b27046b4cf">
Nov 14 08:15:46 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 08:15:46 user nova-compute[75305]:         </nova:port>
Nov 14 08:15:46 user nova-compute[75305]:       </nova:ports>
Nov 14 08:15:46 user nova-compute[75305]:     </nova:instance>
Nov 14 08:15:46 user nova-compute[75305]:   </metadata>
Nov 14 08:15:46 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:15:46 user nova-compute[75305]:     <system>
Nov 14 08:15:46 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:15:46 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:15:46 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:15:46 user nova-compute[75305]:       <entry name="serial">36cc9bba-70f0-4bcd-bf54-81cfd335f797</entry>
Nov 14 08:15:46 user nova-compute[75305]:       <entry name="uuid">36cc9bba-70f0-4bcd-bf54-81cfd335f797</entry>
Nov 14 08:15:46 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:15:46 user nova-compute[75305]:     </system>
Nov 14 08:15:46 user nova-compute[75305]:   </sysinfo>
Nov 14 08:15:46 user nova-compute[75305]:   <os>
Nov 14 08:15:46 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:15:46 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:15:46 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:15:46 user nova-compute[75305]:   </os>
Nov 14 08:15:46 user nova-compute[75305]:   <features>
Nov 14 08:15:46 user nova-compute[75305]:     <acpi/>
Nov 14 08:15:46 user nova-compute[75305]:     <apic/>
Nov 14 08:15:46 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:15:46 user nova-compute[75305]:   </features>
Nov 14 08:15:46 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:15:46 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:15:46 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:15:46 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:15:46 user nova-compute[75305]:   </clock>
Nov 14 08:15:46 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:15:46 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:15:46 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:15:46 user nova-compute[75305]:   </cpu>
Nov 14 08:15:46 user nova-compute[75305]:   <devices>
Nov 14 08:15:46 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:15:46 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:15:46 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk"/>
Nov 14 08:15:46 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:15:46 user nova-compute[75305]:     </disk>
Nov 14 08:15:46 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:15:46 user nova-compute[75305]:       <mac address="fa:16:3e:69:a6:86"/>
Nov 14 08:15:46 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:15:46 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:15:46 user nova-compute[75305]:       <target dev="tap27a201cb-86"/>
Nov 14 08:15:46 user nova-compute[75305]:     </interface>
Nov 14 08:15:46 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:15:46 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/console.log" append="off"/>
Nov 14 08:15:46 user nova-compute[75305]:     </serial>
Nov 14 08:15:46 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:15:46 user nova-compute[75305]:     <video>
Nov 14 08:15:46 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:15:46 user nova-compute[75305]:     </video>
Nov 14 08:15:46 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:15:46 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:15:46 user nova-compute[75305]:     </rng>
Nov 14 08:15:46 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:15:46 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:15:46 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:15:46 user nova-compute[75305]:     </memballoon>
Nov 14 08:15:46 user nova-compute[75305]:   </devices>
Nov 14 08:15:46 user nova-compute[75305]: </domain>
Nov 14 08:15:46 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063802549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063802549',id=33,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-ohrpq3zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:15:44Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=36cc9bba-70f0-4bcd-bf54-81cfd335f797,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:a6:86,bridge_name='br-int',has_traffic_filtering=True,id=27a201cb-868c-4357-a4f1-f4b27046b4cf,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a201cb-86') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG os_vif [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a6:86,bridge_name='br-int',has_traffic_filtering=True,id=27a201cb-868c-4357-a4f1-f4b27046b4cf,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a201cb-86') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37afd18f-d9b9-513a-a9c8-b13f0aeb95c7', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27a201cb-86, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27a201cb-86, col_values=(('qos', UUID('926f2889-f7bf-4963-9f63-22b75e873c02')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27a201cb-86, col_values=(('external_ids', {'iface-id': '27a201cb-868c-4357-a4f1-f4b27046b4cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:a6:86', 'vm-uuid': '36cc9bba-70f0-4bcd-bf54-81cfd335f797'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:46 user nova-compute[75305]: INFO os_vif [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:a6:86,bridge_name='br-int',has_traffic_filtering=True,id=27a201cb-868c-4357-a4f1-f4b27046b4cf,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a201cb-86')
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No VIF found with MAC fa:16:3e:69:a6:86, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:15:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance running successfully.
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Failed to set time: agent not configured {{(pid=75305) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 08:15:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b0bdc556-e367-4f4c-85c9-4f7cbfd0d15b tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] finish_migration finished successfully. {{(pid=75305) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:47 user nova-compute[75305]: WARNING nova.compute.manager [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state resized and task_state None.
Nov 14 08:15:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received event network-changed-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Refreshing instance network info cache due to event network-changed-27a201cb-868c-4357-a4f1-f4b27046b4cf. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] Acquiring lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] Acquired lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG nova.network.neutron [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Refreshing network info cache for port 27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG nova.network.neutron [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Updated VIF entry in instance network info cache for port 27a201cb-868c-4357-a4f1-f4b27046b4cf. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG nova.network.neutron [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Updating instance_info_cache with network_info: [{"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c991e8af-0b34-4540-842d-e3b2bb5cba44 req-ad9f7879-8afd-405c-8feb-2fe709348ba0 service nova] Releasing lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-0b703ebd-d8b4-460c-9a46-da6dbae7153f req-dff4f932-381c-49d4-95b1-2834c822333c service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received event network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0b703ebd-d8b4-460c-9a46-da6dbae7153f req-dff4f932-381c-49d4-95b1-2834c822333c service nova] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0b703ebd-d8b4-460c-9a46-da6dbae7153f req-dff4f932-381c-49d4-95b1-2834c822333c service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0b703ebd-d8b4-460c-9a46-da6dbae7153f req-dff4f932-381c-49d4-95b1-2834c822333c service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-0b703ebd-d8b4-460c-9a46-da6dbae7153f req-dff4f932-381c-49d4-95b1-2834c822333c service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] No waiting events found dispatching network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:48 user nova-compute[75305]: WARNING nova.compute.manager [req-0b703ebd-d8b4-460c-9a46-da6dbae7153f req-dff4f932-381c-49d4-95b1-2834c822333c service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received unexpected event network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf for instance with vm_state building and task_state spawning.
Nov 14 08:15:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:15:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Instance spawned successfully.
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e847b9f-69f9-4481-98a6-c6f5003206b3 req-c722d372-fc27-454c-8545-89ebe67a32eb service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received event network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e847b9f-69f9-4481-98a6-c6f5003206b3 req-c722d372-fc27-454c-8545-89ebe67a32eb service nova] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e847b9f-69f9-4481-98a6-c6f5003206b3 req-c722d372-fc27-454c-8545-89ebe67a32eb service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4e847b9f-69f9-4481-98a6-c6f5003206b3 req-c722d372-fc27-454c-8545-89ebe67a32eb service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-4e847b9f-69f9-4481-98a6-c6f5003206b3 req-c722d372-fc27-454c-8545-89ebe67a32eb service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] No waiting events found dispatching network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:50 user nova-compute[75305]: WARNING nova.compute.manager [req-4e847b9f-69f9-4481-98a6-c6f5003206b3 req-c722d372-fc27-454c-8545-89ebe67a32eb service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received unexpected event network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf for instance with vm_state building and task_state spawning.
Nov 14 08:15:50 user nova-compute[75305]: INFO nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 14 08:15:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:15:50 user nova-compute[75305]: INFO nova.compute.manager [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Took 6.39 seconds to build instance.
Nov 14 08:15:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bb344cd8-01f5-4db1-9e27-e58c88d90176 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.484s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing instance network info cache due to event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:15:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:15:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:15:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:53 user nova-compute[75305]: INFO nova.compute.manager [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Terminating instance
Nov 14 08:15:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updated VIF entry in instance network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d732f5b7-5467-4aba-8545-71787bef8504 req-b12e01b8-224e-4303-95fd-4923e4fa4ef6 service nova] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-66d42fd8-d620-48d8-8716-8c6f1c4a3eda req-2f7a52ef-d214-42c5-bbec-2172b7ea4731 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-unplugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-66d42fd8-d620-48d8-8716-8c6f1c4a3eda req-2f7a52ef-d214-42c5-bbec-2172b7ea4731 service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-66d42fd8-d620-48d8-8716-8c6f1c4a3eda req-2f7a52ef-d214-42c5-bbec-2172b7ea4731 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-66d42fd8-d620-48d8-8716-8c6f1c4a3eda req-2f7a52ef-d214-42c5-bbec-2172b7ea4731 service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-66d42fd8-d620-48d8-8716-8c6f1c4a3eda req-2f7a52ef-d214-42c5-bbec-2172b7ea4731 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-unplugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-66d42fd8-d620-48d8-8716-8c6f1c4a3eda req-2f7a52ef-d214-42c5-bbec-2172b7ea4731 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-unplugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:15:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Instance destroyed successfully.
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.objects.instance [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lazy-loading 'resources' on Instance uuid ba827b89-5258-4f7e-9e5d-eb13f35affd4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:12:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-722280166',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517392847',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFSHuOBu4lWTlW7Vctn1xXnnT45BYbFZ8zeCXHYrkzYMRxRFA3Nz9SmGzjNbbgTlWci9ACTz2z5/PYwN7XHX+Hj6DF4ifeWa+fwkxv/lSrOPQjwXf0hJfz0Ul+A3SAl5Dw==',key_name='tempest-keypair-61336421',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:14:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31e24af031694052bb3ea06040959499',ramdisk_id='',reservation_id='r-gam6gp6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-196740715',owner_user_name='tempest-ServerActionsV293TestJSON-196740715-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='192f4325fbea478aadbf131b02bf891e',uuid=ba827b89-5258-4f7e-9e5d-eb13f35affd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converting VIF {"id": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "address": "fa:16:3e:6a:5d:bd", "network": {"id": "b98e6be6-7577-4898-95b8-7f8683bc5790", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2070386758-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31e24af031694052bb3ea06040959499", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93212f5-8c", "ovs_interfaceid": "f93212f5-8c61-4e7b-9041-ebfa201aaaa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_vif [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf93212f5-8c, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67387e84-464f-42bc-b989-3c7c67ef87dc) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:15:54 user nova-compute[75305]: INFO os_vif [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:5d:bd,bridge_name='br-int',has_traffic_filtering=True,id=f93212f5-8c61-4e7b-9041-ebfa201aaaa2,network=Network(b98e6be6-7577-4898-95b8-7f8683bc5790),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93212f5-8c')
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fcbVKIjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:15:54 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798f000-5a7b-4ca1-8d7e-e4863ff2ea8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:15:54 user nova-compute[75305]: No targets found.
Nov 14 08:15:54 user nova-compute[75305]: iSNS:
Nov 14 08:15:54 user nova-compute[75305]: No targets found.
Nov 14 08:15:54 user nova-compute[75305]: STATIC:
Nov 14 08:15:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a
Nov 14 08:15:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8
Nov 14 08:15:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:15:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:15:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:15:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:15:54 user nova-compute[75305]: FIRMWARE:
Nov 14 08:15:54 user nova-compute[75305]: No targets found.
Nov 14 08:15:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:15:54 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:15:54 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[450ab2d9-41c7-42a6-a68e-9650be6f5ccb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[488860c8-954e-4e14-91a5-2908bebdeb20]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:54 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:54 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:54 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:15:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:15:54 user nova-compute[75305]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a (non-flash)
Nov 14 08:15:54 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:15:54 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:15:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5c3389d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.065s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fd9bea-ca74-4a75-9b05-844139f792a5]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf21a79-67d8-403f-87f3-ad64c3ec25ec]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1d8b72-04fb-4e17-b33e-879e21e1d93b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b63d25-62fd-4b81-a369-e96926434c55]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO50e1fbe8-be068a7f18712093', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_50e1fbe8', '/dev/disk/by-id/scsi-26265303638613766') {{(pid=86224) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 08:15:54 user nova-compute[75305]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO50e1fbe8-be068a7f18712093
Nov 14 08:15:54 user nova-compute[75305]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_50e1fbe8
Nov 14 08:15:54 user nova-compute[75305]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26265303638613766
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f59f19-2268-4e35-a850-6c91d5c85257]: (4, None) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd78ebc-cea4-4cf6-b0c5-406c4333beac]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7c022b-441f-4f4d-8f6b-2065722a216b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260]
Nov 14 08:15:54 user nova-compute[75305]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a, portal: 172.16.0.220,3260] successful.
Nov 14 08:15:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0534c23b-a785-482a-843d-659c7093bb4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[73769923-6015-4dc3-85f1-ff2d73a11835]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] <== disconnect_volume: return (444ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:15:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Deleting instance files /opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4_del
Nov 14 08:15:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Deletion of /opt/stack/data/nova/instances/ba827b89-5258-4f7e-9e5d-eb13f35affd4_del complete
Nov 14 08:15:54 user nova-compute[75305]: INFO nova.compute.manager [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Took 1.69 seconds to destroy the instance on the hypervisor.
Nov 14 08:15:54 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:15:54 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:55 user nova-compute[75305]: INFO nova.compute.manager [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Terminating instance
Nov 14 08:15:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-e95eacf6-339a-4883-a4b6-7eb08100e022 req-bc2c1ad2-d548-416f-8316-3d56a5165f4f service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e95eacf6-339a-4883-a4b6-7eb08100e022 req-bc2c1ad2-d548-416f-8316-3d56a5165f4f service nova] Acquiring lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e95eacf6-339a-4883-a4b6-7eb08100e022 req-bc2c1ad2-d548-416f-8316-3d56a5165f4f service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e95eacf6-339a-4883-a4b6-7eb08100e022 req-bc2c1ad2-d548-416f-8316-3d56a5165f4f service nova] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-e95eacf6-339a-4883-a4b6-7eb08100e022 req-bc2c1ad2-d548-416f-8316-3d56a5165f4f service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] No waiting events found dispatching network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:55 user nova-compute[75305]: WARNING nova.compute.manager [req-e95eacf6-339a-4883-a4b6-7eb08100e022 req-bc2c1ad2-d548-416f-8316-3d56a5165f4f service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received unexpected event network-vif-plugged-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 for instance with vm_state active and task_state deleting.
Nov 14 08:15:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-c7622b46-4bde-44f0-b4ad-46f81b9e8474 req-afc7b888-a31b-4479-b7d0-e164b4b57330 service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received event network-vif-unplugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c7622b46-4bde-44f0-b4ad-46f81b9e8474 req-afc7b888-a31b-4479-b7d0-e164b4b57330 service nova] Acquiring lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c7622b46-4bde-44f0-b4ad-46f81b9e8474 req-afc7b888-a31b-4479-b7d0-e164b4b57330 service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c7622b46-4bde-44f0-b4ad-46f81b9e8474 req-afc7b888-a31b-4479-b7d0-e164b4b57330 service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-c7622b46-4bde-44f0-b4ad-46f81b9e8474 req-afc7b888-a31b-4479-b7d0-e164b4b57330 service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] No waiting events found dispatching network-vif-unplugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-c7622b46-4bde-44f0-b4ad-46f81b9e8474 req-afc7b888-a31b-4479-b7d0-e164b4b57330 service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received event network-vif-unplugged-6dc6555f-7909-4b77-87b9-28797de6f868 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:15:55 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:55 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Took 1.20 seconds to deallocate network for instance.
Nov 14 08:15:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Instance destroyed successfully.
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lazy-loading 'resources' on Instance uuid 6f7b1470-00b1-46d3-a3b3-7c29d822f166 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1003248855',display_name='tempest-VolumesAdminNegativeTest-server-1003248855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1003248855',id=32,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5598d280de473f96c6d0f3500a7a9c',ramdisk_id='',reservation_id='r-qcs9twty',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1378224790',owner_user_name='tempest-VolumesAdminNegativeTest-1378224790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:14:10Z,user_data=None,user_id='26ebac86c4d845d5a2d3ebc50d9d919e',uuid=6f7b1470-00b1-46d3-a3b3-7c29d822f166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converting VIF {"id": "6dc6555f-7909-4b77-87b9-28797de6f868", "address": "fa:16:3e:5e:40:26", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dc6555f-79", "ovs_interfaceid": "6dc6555f-7909-4b77-87b9-28797de6f868", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:40:26,bridge_name='br-int',has_traffic_filtering=True,id=6dc6555f-7909-4b77-87b9-28797de6f868,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc6555f-79') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG os_vif [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:40:26,bridge_name='br-int',has_traffic_filtering=True,id=6dc6555f-7909-4b77-87b9-28797de6f868,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc6555f-79') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dc6555f-79, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3254e3e8-4946-45c5-9107-10df35da5b78) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:56 user nova-compute[75305]: INFO os_vif [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:40:26,bridge_name='br-int',has_traffic_filtering=True,id=6dc6555f-7909-4b77-87b9-28797de6f868,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dc6555f-79')
Nov 14 08:15:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Deleting instance files /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166_del
Nov 14 08:15:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Deletion of /opt/stack/data/nova/instances/6f7b1470-00b1-46d3-a3b3-7c29d822f166_del complete
Nov 14 08:15:56 user nova-compute[75305]: INFO nova.compute.manager [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 14 08:15:56 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:15:56 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Took 0.46 seconds to deallocate network for instance.
Nov 14 08:15:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:56 user nova-compute[75305]: INFO nova.compute.manager [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Took 0.85 seconds to detach 1 volumes for instance.
Nov 14 08:15:56 user nova-compute[75305]: DEBUG nova.compute.manager [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Deleting volume: 0534c23b-a785-482a-843d-659c7093bb4a {{(pid=75305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:56 user nova-compute[75305]: INFO nova.compute.manager [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Shelving
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.199s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:57 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Deleted allocations for instance 6f7b1470-00b1-46d3-a3b3-7c29d822f166
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b3d5f9d5-081a-4370-b208-41fcd138ed8c tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-e46e5aee-53e0-4c84-938c-c5b7f6af31fe req-be72e18c-0df6-402c-b02a-a7a92f59315d service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e46e5aee-53e0-4c84-938c-c5b7f6af31fe req-be72e18c-0df6-402c-b02a-a7a92f59315d service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e46e5aee-53e0-4c84-938c-c5b7f6af31fe req-be72e18c-0df6-402c-b02a-a7a92f59315d service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e46e5aee-53e0-4c84-938c-c5b7f6af31fe req-be72e18c-0df6-402c-b02a-a7a92f59315d service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-e46e5aee-53e0-4c84-938c-c5b7f6af31fe req-be72e18c-0df6-402c-b02a-a7a92f59315d service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:57 user nova-compute[75305]: WARNING nova.compute.manager [req-e46e5aee-53e0-4c84-938c-c5b7f6af31fe req-be72e18c-0df6-402c-b02a-a7a92f59315d service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state active and task_state shelving.
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:57 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Deleted allocations for instance ba827b89-5258-4f7e-9e5d-eb13f35affd4
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-95b78cfa-c9ec-4e38-9483-faed9c5f2ff7 tempest-ServerActionsV293TestJSON-196740715 tempest-ServerActionsV293TestJSON-196740715-project-member] Lock "ba827b89-5258-4f7e-9e5d-eb13f35affd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.580s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance destroyed successfully.
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] [instance: ba827b89-5258-4f7e-9e5d-eb13f35affd4] Received event network-vif-deleted-f93212f5-8c61-4e7b-9041-ebfa201aaaa2 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received event network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] Acquiring lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] Lock "6f7b1470-00b1-46d3-a3b3-7c29d822f166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] No waiting events found dispatching network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:57 user nova-compute[75305]: WARNING nova.compute.manager [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received unexpected event network-vif-plugged-6dc6555f-7909-4b77-87b9-28797de6f868 for instance with vm_state deleted and task_state None.
Nov 14 08:15:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-13efdd4b-fc40-481f-bdc5-eb0ca1d58375 req-2284c004-da8f-49b3-9361-25289ed63343 service nova] [instance: 6f7b1470-00b1-46d3-a3b3-7c29d822f166] Received event network-vif-deleted-6dc6555f-7909-4b77-87b9-28797de6f868 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Beginning cold snapshot process
Nov 14 08:15:58 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk /opt/stack/data/nova/instances/snapshots/tmp_fxjo1av/692257cbcf4b4db984e36f823df27d51 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk /opt/stack/data/nova/instances/snapshots/tmp_fxjo1av/692257cbcf4b4db984e36f823df27d51" returned: 0 in 1.020s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:15:59 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Snapshot extracted, beginning image upload
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:59 user nova-compute[75305]: WARNING nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:59 user nova-compute[75305]: WARNING nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:59 user nova-compute[75305]: WARNING nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:59 user nova-compute[75305]: WARNING nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:15:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:15:59 user nova-compute[75305]: WARNING nova.compute.manager [req-ef182490-bcbd-412f-b8a9-adcc12e7d698 req-d9c1f78b-8354-45d6-a3ee-32852c56b8d7 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 08:16:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Snapshot image upload complete
Nov 14 08:16:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:16:01 user nova-compute[75305]: INFO nova.compute.manager [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Shelve offloading
Nov 14 08:16:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance destroyed successfully.
Nov 14 08:16:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:16:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:16:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:16:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:16:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance destroyed successfully.
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'resources' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1368613915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1368613915',id=31,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbwQrOK1QlSZE6X9q8X1qCTf/gx8bD3GXyvl57doyWYQp50KgqQvUBKaoJz29uESl1iUVmTxK/3HfdjqW8RDxaQT9FjAJKojDLe2G76ZMiK6Z1z6yBB3F3wE5dLjd2D0g==',key_name='tempest-keypair-300441375',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-diqu32dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member',shelved_at='2023-11-14T08:16:01.498430',shelved_host='user',shelved_image_id='ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:15:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=888926e8-0eea-4900-98cf-968133edcfab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG os_vif [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0f27b62-3b, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36c6ffc3-bae2-468a-a6fb-623b19139a56) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing instance network info cache due to event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.network.neutron [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:16:02 user nova-compute[75305]: INFO os_vif [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b')
Nov 14 08:16:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Deleting instance files /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab_del
Nov 14 08:16:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Deletion of /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab_del complete
Nov 14 08:16:02 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Deleted allocations for instance 888926e8-0eea-4900-98cf-968133edcfab
Nov 14 08:16:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'numa_topology' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:16:02 user nova-compute[75305]: DEBUG nova.objects.base [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<888926e8-0eea-4900-98cf-968133edcfab> lazy-loaded attributes: resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2c723c0-7f4c-4500-a7a1-89ac1a9fca27 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.227s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updated VIF entry in instance network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tape0f27b62-3b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:16:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cf23d7a7-8631-43fa-ac0e-9792b480672a req-040b3995-b22a-46d4-bedd-683546d9f405 service nova] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:16:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:16:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:21 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:23 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:16:23 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:16:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8022MB free_disk=25.02606201171875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Applying migration context for instance 961e2d61-c567-4861-974f-7cd205244bee as it has an incoming, in-progress migration f5aeda3f-0457-4a18-98d4-336462241a2a. Migration status is finished {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 08:16:23 user nova-compute[75305]: INFO nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating resource usage from migration f5aeda3f-0457-4a18-98d4-336462241a2a
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba89d1e7-a713-49c3-bed9-317725c13f1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Migration f5aeda3f-0457-4a18-98d4-336462241a2a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 961e2d61-c567-4861-974f-7cd205244bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:16:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:27 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5e23822-868e-4437-b87b-487179175d6c] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:16:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:16:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:16:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:16:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:16:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:16:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:16:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:48 user nova-compute[75305]: INFO nova.compute.manager [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Terminating instance
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-bd13e1d2-d318-4b4d-be16-a6c60d625e7c req-ca420124-5b18-4467-acd4-5dd3b3e83afd service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-vif-unplugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd13e1d2-d318-4b4d-be16-a6c60d625e7c req-ca420124-5b18-4467-acd4-5dd3b3e83afd service nova] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd13e1d2-d318-4b4d-be16-a6c60d625e7c req-ca420124-5b18-4467-acd4-5dd3b3e83afd service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bd13e1d2-d318-4b4d-be16-a6c60d625e7c req-ca420124-5b18-4467-acd4-5dd3b3e83afd service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-bd13e1d2-d318-4b4d-be16-a6c60d625e7c req-ca420124-5b18-4467-acd4-5dd3b3e83afd service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] No waiting events found dispatching network-vif-unplugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-bd13e1d2-d318-4b4d-be16-a6c60d625e7c req-ca420124-5b18-4467-acd4-5dd3b3e83afd service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-vif-unplugged-eac08684-f54c-4430-898e-099dcd15a69d for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:16:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Instance destroyed successfully.
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.objects.instance [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lazy-loading 'resources' on Instance uuid fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:11:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1298423447',display_name='tempest-VolumesAdminNegativeTest-server-1298423447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1298423447',id=26,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsdAw/u3j3EXSBLIf425rc0/tBzRYQC5N7OlVDbAdaDgKCamGhwkKekJXDV2d3Lm1lus7vaQTktqWB5/fvDCmiGti+t4OEGTxNnorO7wy5vj+gJkT2Lc7/3HG7aw9juhA==',key_name='tempest-keypair-2098536338',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:11:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae5598d280de473f96c6d0f3500a7a9c',ramdisk_id='',reservation_id='r-jstwphjj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1378224790',owner_user_name='tempest-VolumesAdminNegativeTest-1378224790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:11:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ebac86c4d845d5a2d3ebc50d9d919e',uuid=fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converting VIF {"id": "eac08684-f54c-4430-898e-099dcd15a69d", "address": "fa:16:3e:95:2b:4a", "network": {"id": "33863bec-e479-45b6-a758-f2dfaf385f1b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-948351916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae5598d280de473f96c6d0f3500a7a9c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeac08684-f5", "ovs_interfaceid": "eac08684-f54c-4430-898e-099dcd15a69d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:2b:4a,bridge_name='br-int',has_traffic_filtering=True,id=eac08684-f54c-4430-898e-099dcd15a69d,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac08684-f5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG os_vif [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:2b:4a,bridge_name='br-int',has_traffic_filtering=True,id=eac08684-f54c-4430-898e-099dcd15a69d,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac08684-f5') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeac08684-f5, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c9352ab-2c72-4f0c-bd5c-e8b4b95c8a5f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:16:48 user nova-compute[75305]: INFO os_vif [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:2b:4a,bridge_name='br-int',has_traffic_filtering=True,id=eac08684-f54c-4430-898e-099dcd15a69d,network=Network(33863bec-e479-45b6-a758-f2dfaf385f1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeac08684-f5')
Nov 14 08:16:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Deleting instance files /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d_del
Nov 14 08:16:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Deletion of /opt/stack/data/nova/instances/fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d_del complete
Nov 14 08:16:48 user nova-compute[75305]: INFO nova.compute.manager [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 08:16:48 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:16:48 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:16:49 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:16:49 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Took 0.72 seconds to deallocate network for instance.
Nov 14 08:16:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-3b856395-3347-407c-a60f-cb192a5b02ea req-8b05e32c-5b44-49c7-af41-9879525dac00 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-vif-deleted-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:16:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.299s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:50 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Deleted allocations for instance fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d
Nov 14 08:16:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-10d4f8ba-d261-4a2f-bf6d-aa435f394bb3 tempest-VolumesAdminNegativeTest-1378224790 tempest-VolumesAdminNegativeTest-1378224790-project-member] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-dbde9198-6d0f-4aa7-801e-1545a6cf566d req-33e50d26-f210-43fb-8794-08a55ecd15c8 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received event network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dbde9198-6d0f-4aa7-801e-1545a6cf566d req-33e50d26-f210-43fb-8794-08a55ecd15c8 service nova] Acquiring lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dbde9198-6d0f-4aa7-801e-1545a6cf566d req-33e50d26-f210-43fb-8794-08a55ecd15c8 service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dbde9198-6d0f-4aa7-801e-1545a6cf566d req-33e50d26-f210-43fb-8794-08a55ecd15c8 service nova] Lock "fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:16:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-dbde9198-6d0f-4aa7-801e-1545a6cf566d req-33e50d26-f210-43fb-8794-08a55ecd15c8 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] No waiting events found dispatching network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:16:50 user nova-compute[75305]: WARNING nova.compute.manager [req-dbde9198-6d0f-4aa7-801e-1545a6cf566d req-33e50d26-f210-43fb-8794-08a55ecd15c8 service nova] [instance: fa8063e2-8873-4acc-8f3a-cb0b5b7bf23d] Received unexpected event network-vif-plugged-eac08684-f54c-4430-898e-099dcd15a69d for instance with vm_state deleted and task_state None.
Nov 14 08:16:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:16:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing instance network info cache due to event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:16:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:16:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:16:55 user nova-compute[75305]: DEBUG nova.network.neutron [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:16:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updated VIF entry in instance network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:16:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:16:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-23ec709a-4c7e-4b49-aa72-259c915c9e9e req-b8b19361-c7db-4442-b625-9620923e67c3 service nova] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:16:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:16:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:16:56 user nova-compute[75305]: INFO nova.compute.manager [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Detaching volume 2f8a4760-4834-4861-bc58-ba917f484ae8
Nov 14 08:16:56 user nova-compute[75305]: INFO nova.virt.block_device [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Attempting to driver detach volume 2f8a4760-4834-4861-bc58-ba917f484ae8 from mountpoint /dev/vdb
Nov 14 08:16:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Attempting to detach device vdb from instance ba89d1e7-a713-49c3-bed9-317725c13f1c from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:16:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:16:56 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:16:56 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:16:56 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:16:56 user nova-compute[75305]:   <serial>2f8a4760-4834-4861-bc58-ba917f484ae8</serial>
Nov 14 08:16:56 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:16:56 user nova-compute[75305]: </disk>
Nov 14 08:16:56 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:16:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully detached device vdb from instance ba89d1e7-a713-49c3-bed9-317725c13f1c from the persistent domain config.
Nov 14 08:16:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ba89d1e7-a713-49c3-bed9-317725c13f1c from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:16:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:16:56 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:16:56 user nova-compute[75305]:   <source dev="/dev/sdf"/>
Nov 14 08:16:56 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:16:56 user nova-compute[75305]:   <serial>2f8a4760-4834-4861-bc58-ba917f484ae8</serial>
Nov 14 08:16:56 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:16:56 user nova-compute[75305]: </disk>
Nov 14 08:16:56 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:16:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ba89d1e7-a713-49c3-bed9-317725c13f1c {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:16:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:16:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing instance network info cache due to event network-changed-d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:16:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:16:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:16:57 user nova-compute[75305]: DEBUG nova.network.neutron [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Refreshing network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:16:58 user nova-compute[75305]: DEBUG nova.network.neutron [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updated VIF entry in instance network info cache for port d223db2f-fbcd-4b02-bc61-1455cbb63a7a. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:16:58 user nova-compute[75305]: DEBUG nova.network.neutron [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:16:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8340bf16-8b7e-415f-b4f6-8a2e446777cf req-605b98b4-bedd-4585-8f63-4d6f29d5ceae service nova] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:16:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:16:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:17 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ba89d1e7-a713-49c3-bed9-317725c13f1c is timed out.
Nov 14 08:17:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully detached device vdb from instance ba89d1e7-a713-49c3-bed9-317725c13f1c from the live domain config.
Nov 14 08:17:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UDVFINYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:17:17 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e580df71-6ef0-4c5f-b508-02099e3cacb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:17:17 user nova-compute[75305]: No targets found.
Nov 14 08:17:17 user nova-compute[75305]: iSNS:
Nov 14 08:17:17 user nova-compute[75305]: No targets found.
Nov 14 08:17:17 user nova-compute[75305]: STATIC:
Nov 14 08:17:17 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8
Nov 14 08:17:17 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:17:17 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:17:17 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:17:17 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:17:17 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:17:17 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:17:17 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:17:17 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:17:17 user nova-compute[75305]: FIRMWARE:
Nov 14 08:17:17 user nova-compute[75305]: No targets found.
Nov 14 08:17:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:17:17 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:17:17 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc15d5de-b066-4859-acb1-03344ae500fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[48da22ec-b27d-462b-b2eb-cd911cdfa28c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:17:17 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:17:17 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:17:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:17:17 user nova-compute[75305]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 (non-flash)
Nov 14 08:17:17 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:17:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4410c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8'): ({'sdf'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Removing single pathed devices sdf {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[118487e9-35af-4ffd-a993-0372d95c254f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0c033b-c2c2-4dec-b691-dde364a04775]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Flushing IO for device /dev/sdf {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ed237-86ea-4329-93df-d17dd6713ea6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d148c758-4b0c-450d-8ee7-1a0b620d7856]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] SCSI volumes sdf have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71f841f-68b2-48bc-9291-a3d1b7550290]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbcfe38-6bdf-472c-87a8-6a402d87b3f2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260]
Nov 14 08:17:17 user nova-compute[75305]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8, portal: 172.16.0.220,3260] successful.
Nov 14 08:17:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f8a4760-4834-4861-bc58-ba917f484ae8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a286ca5-799e-409c-98ec-f34453a934f0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] <== disconnect_volume: return (269ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:17:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:17:18 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'flavor' on Instance uuid ba89d1e7-a713-49c3-bed9-317725c13f1c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4956b84d-a7b8-48d0-94eb-3d8f630cfc84 tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.686s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:17:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:22 user nova-compute[75305]: DEBUG nova.compute.manager [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Going to confirm migration 2 {{(pid=75305) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 08:17:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:17:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquired lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:17:22 user nova-compute[75305]: DEBUG nova.network.neutron [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:17:22 user nova-compute[75305]: DEBUG nova.objects.instance [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'info_cache' on Instance uuid 961e2d61-c567-4861-974f-7cd205244bee {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Releasing lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG nova.objects.instance [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'migration_context' on Instance uuid 961e2d61-c567-4861-974f-7cd205244bee {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG nova.objects.base [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Object Instance<961e2d61-c567-4861-974f-7cd205244bee> lazy-loaded attributes: info_cache,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.459s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:24 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Deleted allocation for migration f5aeda3f-0457-4a18-98d4-336462241a2a
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-299b39d8-d76c-49fe-99ff-bd6c9802215a tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.007s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:17:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8234MB free_disk=25.040691375732422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ba89d1e7-a713-49c3-bed9-317725c13f1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 961e2d61-c567-4861-974f-7cd205244bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:17:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.424s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:29 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:17:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:17:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:17:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:17:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:17:31 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [{"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:17:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-ba89d1e7-a713-49c3-bed9-317725c13f1c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:17:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:17:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:17:35 user nova-compute[75305]: INFO nova.compute.manager [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] instance snapshotting
Nov 14 08:17:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Beginning live snapshot process
Nov 14 08:17:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0nq3u4s2/512a7053f9254c6582604897aba824ab.delta 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0nq3u4s2/512a7053f9254c6582604897aba824ab.delta 1073741824" returned: 0 in 0.053s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:17:36 user nova-compute[75305]: INFO nova.compute.claims [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Claim successful on node user
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.network.neutron [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:17:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.policy [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0b561dad6d74acfa63122951faf8f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b3c6c530ef4c20b176189616d71c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:17:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Creating image(s)
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "/opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "/opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk 1073741824" returned: 0 in 0.076s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:17:37 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG nova.network.neutron [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Successfully created port: 9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0nq3u4s2/512a7053f9254c6582604897aba824ab.delta /opt/stack/data/nova/instances/snapshots/tmp0nq3u4s2/512a7053f9254c6582604897aba824ab {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Cannot resize image /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Ensure instance console log exists: /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Successfully updated port: 9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquired lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0nq3u4s2/512a7053f9254c6582604897aba824ab.delta /opt/stack/data/nova/instances/snapshots/tmp0nq3u4s2/512a7053f9254c6582604897aba824ab" returned: 0 in 0.858s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Snapshot extracted, beginning image upload
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.compute.manager [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-changed-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.compute.manager [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Refreshing instance network info cache due to event network-changed-9e489d79-373d-49d1-aead-bf240bc0fe3c. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] Acquiring lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updating instance_info_cache with network_info: [{"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Releasing lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Instance network_info: |[{"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] Acquired lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.neutron [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Refreshing network info cache for port 9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Start _get_guest_xml network_info=[{"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:17:38 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:17:38 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-552197203',display_name='tempest-TestStampPattern-server-552197203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-552197203',id=34,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDECpqXZ39yJhKNBdtHyasJhkEpTXP1jf3ZW+cfIJ2zbLVCmgEy5+PFQBkFXCyo6idt7/qq9uAbj+UgLZkJ9h0TNVNbnRQfF91Cg5e9J2qAT5cWwGnjSjvl8hUs4n/TyWg==',key_name='tempest-TestStampPattern-1143433304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38b3c6c530ef4c20b176189616d71c56',ramdisk_id='',reservation_id='r-uftn57vv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1608752450',owner_user_name='tempest-TestStampPattern-1608752450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:17:37Z,user_data=None,user_id='b0b561dad6d74acfa63122951faf8f37',uuid=5b229490-ec43-495b-88f4-b829dd71c07b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converting VIF {"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:43:df,bridge_name='br-int',has_traffic_filtering=True,id=9e489d79-373d-49d1-aead-bf240bc0fe3c,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e489d79-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b229490-ec43-495b-88f4-b829dd71c07b {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:17:38 user nova-compute[75305]:   <uuid>5b229490-ec43-495b-88f4-b829dd71c07b</uuid>
Nov 14 08:17:38 user nova-compute[75305]:   <name>instance-00000022</name>
Nov 14 08:17:38 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:17:38 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:17:38 user nova-compute[75305]:   <metadata>
Nov 14 08:17:38 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:17:38 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:17:38 user nova-compute[75305]:       <nova:name>tempest-TestStampPattern-server-552197203</nova:name>
Nov 14 08:17:38 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:17:38</nova:creationTime>
Nov 14 08:17:38 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:17:38 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:17:38 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:17:38 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:17:38 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:17:38 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:17:38 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:17:38 user nova-compute[75305]:       <nova:owner>
Nov 14 08:17:38 user nova-compute[75305]:         <nova:user uuid="b0b561dad6d74acfa63122951faf8f37">tempest-TestStampPattern-1608752450-project-member</nova:user>
Nov 14 08:17:38 user nova-compute[75305]:         <nova:project uuid="38b3c6c530ef4c20b176189616d71c56">tempest-TestStampPattern-1608752450</nova:project>
Nov 14 08:17:38 user nova-compute[75305]:       </nova:owner>
Nov 14 08:17:38 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:17:38 user nova-compute[75305]:       <nova:ports>
Nov 14 08:17:38 user nova-compute[75305]:         <nova:port uuid="9e489d79-373d-49d1-aead-bf240bc0fe3c">
Nov 14 08:17:38 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:17:38 user nova-compute[75305]:         </nova:port>
Nov 14 08:17:38 user nova-compute[75305]:       </nova:ports>
Nov 14 08:17:38 user nova-compute[75305]:     </nova:instance>
Nov 14 08:17:38 user nova-compute[75305]:   </metadata>
Nov 14 08:17:38 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:17:38 user nova-compute[75305]:     <system>
Nov 14 08:17:38 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:17:38 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:17:38 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:17:38 user nova-compute[75305]:       <entry name="serial">5b229490-ec43-495b-88f4-b829dd71c07b</entry>
Nov 14 08:17:38 user nova-compute[75305]:       <entry name="uuid">5b229490-ec43-495b-88f4-b829dd71c07b</entry>
Nov 14 08:17:38 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:17:38 user nova-compute[75305]:     </system>
Nov 14 08:17:38 user nova-compute[75305]:   </sysinfo>
Nov 14 08:17:38 user nova-compute[75305]:   <os>
Nov 14 08:17:38 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:17:38 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:17:38 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:17:38 user nova-compute[75305]:   </os>
Nov 14 08:17:38 user nova-compute[75305]:   <features>
Nov 14 08:17:38 user nova-compute[75305]:     <acpi/>
Nov 14 08:17:38 user nova-compute[75305]:     <apic/>
Nov 14 08:17:38 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:17:38 user nova-compute[75305]:   </features>
Nov 14 08:17:38 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:17:38 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:17:38 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:17:38 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:17:38 user nova-compute[75305]:   </clock>
Nov 14 08:17:38 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:17:38 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:17:38 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:17:38 user nova-compute[75305]:   </cpu>
Nov 14 08:17:38 user nova-compute[75305]:   <devices>
Nov 14 08:17:38 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:17:38 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:17:38 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk"/>
Nov 14 08:17:38 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:17:38 user nova-compute[75305]:     </disk>
Nov 14 08:17:38 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:17:38 user nova-compute[75305]:       <mac address="fa:16:3e:96:43:df"/>
Nov 14 08:17:38 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:17:38 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:17:38 user nova-compute[75305]:       <target dev="tap9e489d79-37"/>
Nov 14 08:17:38 user nova-compute[75305]:     </interface>
Nov 14 08:17:38 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:17:38 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/console.log" append="off"/>
Nov 14 08:17:38 user nova-compute[75305]:     </serial>
Nov 14 08:17:38 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:17:38 user nova-compute[75305]:     <video>
Nov 14 08:17:38 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:17:38 user nova-compute[75305]:     </video>
Nov 14 08:17:38 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:17:38 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:17:38 user nova-compute[75305]:     </rng>
Nov 14 08:17:38 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:17:38 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:17:38 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:17:38 user nova-compute[75305]:     </memballoon>
Nov 14 08:17:38 user nova-compute[75305]:   </devices>
Nov 14 08:17:38 user nova-compute[75305]: </domain>
Nov 14 08:17:38 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-552197203',display_name='tempest-TestStampPattern-server-552197203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-552197203',id=34,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDECpqXZ39yJhKNBdtHyasJhkEpTXP1jf3ZW+cfIJ2zbLVCmgEy5+PFQBkFXCyo6idt7/qq9uAbj+UgLZkJ9h0TNVNbnRQfF91Cg5e9J2qAT5cWwGnjSjvl8hUs4n/TyWg==',key_name='tempest-TestStampPattern-1143433304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38b3c6c530ef4c20b176189616d71c56',ramdisk_id='',reservation_id='r-uftn57vv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1608752450',owner_user_name='tempest-TestStampPattern-1608752450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:17:37Z,user_data=None,user_id='b0b561dad6d74acfa63122951faf8f37',uuid=5b229490-ec43-495b-88f4-b829dd71c07b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converting VIF {"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:43:df,bridge_name='br-int',has_traffic_filtering=True,id=9e489d79-373d-49d1-aead-bf240bc0fe3c,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e489d79-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG os_vif [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:43:df,bridge_name='br-int',has_traffic_filtering=True,id=9e489d79-373d-49d1-aead-bf240bc0fe3c,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e489d79-37') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b9c9fa9-80e2-566a-9ba2-7cd23c65d8df', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e489d79-37, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9e489d79-37, col_values=(('qos', UUID('3c5fcc87-8850-499a-a73c-d45367441035')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9e489d79-37, col_values=(('external_ids', {'iface-id': '9e489d79-373d-49d1-aead-bf240bc0fe3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:43:df', 'vm-uuid': '5b229490-ec43-495b-88f4-b829dd71c07b'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:38 user nova-compute[75305]: INFO os_vif [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:43:df,bridge_name='br-int',has_traffic_filtering=True,id=9e489d79-373d-49d1-aead-bf240bc0fe3c,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e489d79-37')
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:17:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No VIF found with MAC fa:16:3e:96:43:df, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:17:39 user nova-compute[75305]: DEBUG nova.network.neutron [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updated VIF entry in instance network info cache for port 9e489d79-373d-49d1-aead-bf240bc0fe3c. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:17:39 user nova-compute[75305]: DEBUG nova.network.neutron [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updating instance_info_cache with network_info: [{"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:17:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1dddb175-6e42-415b-ae1a-2a8041b5fcf8 req-3d360aaf-29ad-4d7d-bfe4-8f664665eb08 service nova] Releasing lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-d5a52ab7-f625-4c38-b76f-fc14471eb51b req-03bc52e0-bab2-468e-a0af-31a80dac464a service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d5a52ab7-f625-4c38-b76f-fc14471eb51b req-03bc52e0-bab2-468e-a0af-31a80dac464a service nova] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d5a52ab7-f625-4c38-b76f-fc14471eb51b req-03bc52e0-bab2-468e-a0af-31a80dac464a service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d5a52ab7-f625-4c38-b76f-fc14471eb51b req-03bc52e0-bab2-468e-a0af-31a80dac464a service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-d5a52ab7-f625-4c38-b76f-fc14471eb51b req-03bc52e0-bab2-468e-a0af-31a80dac464a service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] No waiting events found dispatching network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:17:40 user nova-compute[75305]: WARNING nova.compute.manager [req-d5a52ab7-f625-4c38-b76f-fc14471eb51b req-03bc52e0-bab2-468e-a0af-31a80dac464a service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received unexpected event network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c for instance with vm_state building and task_state spawning.
Nov 14 08:17:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Snapshot image upload complete
Nov 14 08:17:41 user nova-compute[75305]: INFO nova.compute.manager [None req-7a139938-3e1e-42d5-a072-c2d545632fca tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Took 5.72 seconds to snapshot the instance on the hypervisor.
Nov 14 08:17:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:17:42 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Instance spawned successfully.
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:17:42 user nova-compute[75305]: INFO nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Took 5.98 seconds to spawn the instance on the hypervisor.
Nov 14 08:17:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:17:42 user nova-compute[75305]: INFO nova.compute.manager [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Took 6.75 seconds to build instance.
Nov 14 08:17:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-371f411b-c618-44d2-8431-28992ed51696 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.085s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-dc54739e-7f36-4f99-aff8-dec21fb4aa41 req-ccea049f-d408-4cb6-b50d-17059f417831 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dc54739e-7f36-4f99-aff8-dec21fb4aa41 req-ccea049f-d408-4cb6-b50d-17059f417831 service nova] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dc54739e-7f36-4f99-aff8-dec21fb4aa41 req-ccea049f-d408-4cb6-b50d-17059f417831 service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dc54739e-7f36-4f99-aff8-dec21fb4aa41 req-ccea049f-d408-4cb6-b50d-17059f417831 service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-dc54739e-7f36-4f99-aff8-dec21fb4aa41 req-ccea049f-d408-4cb6-b50d-17059f417831 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] No waiting events found dispatching network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:17:43 user nova-compute[75305]: WARNING nova.compute.manager [req-dc54739e-7f36-4f99-aff8-dec21fb4aa41 req-ccea049f-d408-4cb6-b50d-17059f417831 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received unexpected event network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c for instance with vm_state active and task_state None.
Nov 14 08:17:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:49 user nova-compute[75305]: INFO nova.compute.manager [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Terminating instance
Nov 14 08:17:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b052390-8b96-4fd4-850f-0933368c28ca req-cd775b3b-e73e-4fe5-8c80-1ec7770a89ad service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b052390-8b96-4fd4-850f-0933368c28ca req-cd775b3b-e73e-4fe5-8c80-1ec7770a89ad service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b052390-8b96-4fd4-850f-0933368c28ca req-cd775b3b-e73e-4fe5-8c80-1ec7770a89ad service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b052390-8b96-4fd4-850f-0933368c28ca req-cd775b3b-e73e-4fe5-8c80-1ec7770a89ad service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b052390-8b96-4fd4-850f-0933368c28ca req-cd775b3b-e73e-4fe5-8c80-1ec7770a89ad service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:17:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b052390-8b96-4fd4-850f-0933368c28ca req-cd775b3b-e73e-4fe5-8c80-1ec7770a89ad service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-unplugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Instance destroyed successfully.
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lazy-loading 'resources' on Instance uuid ba89d1e7-a713-49c3-bed9-317725c13f1c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:12:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1658184934',display_name='tempest-TestMinimumBasicScenario-server-1658184934',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1658184934',id=29,image_ref='e2f5047e-7a0b-407a-8593-a0aa79e34085',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBED3cvT+kgEr0gKriVno4jkRgUS8y+7LSlup37wKilRo+LuBbz/cevjLkzq1INV25dxtRuPpwVWpfTv3BRhDZHg9b6e97kdWGyi58sF8b/0KHro/3ENaUfN73aUD3lVLlA==',key_name='tempest-TestMinimumBasicScenario-746307838',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:13:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21b880ff94ef40409fe2b772dee93662',ramdisk_id='',reservation_id='r-89rhk0sg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e2f5047e-7a0b-407a-8593-a0aa79e34085',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1127831644',owner_user_name='tempest-TestMinimumBasicScenario-1127831644-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:15:11Z,user_data=None,user_id='f7906829f99049d2bb0a97c80917cb3a',uuid=ba89d1e7-a713-49c3-bed9-317725c13f1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converting VIF {"id": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "address": "fa:16:3e:5a:24:8d", "network": {"id": "0dfce6b1-5862-4996-82f8-a13b7f4aef35", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-712006727-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21b880ff94ef40409fe2b772dee93662", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd223db2f-fb", "ovs_interfaceid": "d223db2f-fbcd-4b02-bc61-1455cbb63a7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:24:8d,bridge_name='br-int',has_traffic_filtering=True,id=d223db2f-fbcd-4b02-bc61-1455cbb63a7a,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd223db2f-fb') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG os_vif [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:24:8d,bridge_name='br-int',has_traffic_filtering=True,id=d223db2f-fbcd-4b02-bc61-1455cbb63a7a,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd223db2f-fb') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd223db2f-fb, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3af4847-e014-49d7-93ba-08a337dd6f1e) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:17:50 user nova-compute[75305]: INFO os_vif [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:24:8d,bridge_name='br-int',has_traffic_filtering=True,id=d223db2f-fbcd-4b02-bc61-1455cbb63a7a,network=Network(0dfce6b1-5862-4996-82f8-a13b7f4aef35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd223db2f-fb')
Nov 14 08:17:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Deleting instance files /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c_del
Nov 14 08:17:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Deletion of /opt/stack/data/nova/instances/ba89d1e7-a713-49c3-bed9-317725c13f1c_del complete
Nov 14 08:17:50 user nova-compute[75305]: INFO nova.compute.manager [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 14 08:17:50 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:50 user nova-compute[75305]: INFO nova.compute.manager [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Unshelving
Nov 14 08:17:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.objects.instance [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'pci_requests' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.objects.instance [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'numa_topology' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:50 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:17:50 user nova-compute[75305]: INFO nova.compute.claims [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Claim successful on node user
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:51 user nova-compute[75305]: INFO nova.network.neutron [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating port e0f27b62-3bdf-4058-9311-bd610be6b581 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:17:51 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Took 0.98 seconds to deallocate network for instance.
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-2bee5141-d696-49f8-8572-9b690d65bbb5 req-67d7273f-e2a6-4330-a8bf-133f637dc51c service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2bee5141-d696-49f8-8572-9b690d65bbb5 req-67d7273f-e2a6-4330-a8bf-133f637dc51c service nova] Acquiring lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2bee5141-d696-49f8-8572-9b690d65bbb5 req-67d7273f-e2a6-4330-a8bf-133f637dc51c service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2bee5141-d696-49f8-8572-9b690d65bbb5 req-67d7273f-e2a6-4330-a8bf-133f637dc51c service nova] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-2bee5141-d696-49f8-8572-9b690d65bbb5 req-67d7273f-e2a6-4330-a8bf-133f637dc51c service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] No waiting events found dispatching network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:17:51 user nova-compute[75305]: WARNING nova.compute.manager [req-2bee5141-d696-49f8-8572-9b690d65bbb5 req-67d7273f-e2a6-4330-a8bf-133f637dc51c service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received unexpected event network-vif-plugged-d223db2f-fbcd-4b02-bc61-1455cbb63a7a for instance with vm_state deleted and task_state None.
Nov 14 08:17:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-2bee5141-d696-49f8-8572-9b690d65bbb5 req-67d7273f-e2a6-4330-a8bf-133f637dc51c service nova] [instance: ba89d1e7-a713-49c3-bed9-317725c13f1c] Received event network-vif-deleted-d223db2f-fbcd-4b02-bc61-1455cbb63a7a {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:51 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Deleted allocations for instance ba89d1e7-a713-49c3-bed9-317725c13f1c
Nov 14 08:17:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b9e4914a-c559-4891-8d32-07fb0b18a23f tempest-TestMinimumBasicScenario-1127831644 tempest-TestMinimumBasicScenario-1127831644-project-member] Lock "ba89d1e7-a713-49c3-bed9-317725c13f1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.693s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing instance network info cache due to event network-changed-e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:17:52 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Creating image(s)
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.objects.instance [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'trusted_certs' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Refreshing network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG nova.objects.base [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<888926e8-0eea-4900-98cf-968133edcfab> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "1c2393b0eda040c3bbcefcec18c22b3dea826fa6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "1c2393b0eda040c3bbcefcec18c22b3dea826fa6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG nova.virt.images [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.part /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updated VIF entry in instance network info cache for port e0f27b62-3bdf-4058-9311-bd610be6b581. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:17:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6269e16b-539f-4f9b-9af6-a7ff5c4a0147 req-367268b3-c82a-4521-9b8e-631765a00aa6 service nova] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.part /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.converted" returned: 0 in 0.478s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "1c2393b0eda040c3bbcefcec18c22b3dea826fa6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.755s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6 --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "1c2393b0eda040c3bbcefcec18c22b3dea826fa6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "1c2393b0eda040c3bbcefcec18c22b3dea826fa6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6 --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6,backing_fmt=raw /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6,backing_fmt=raw /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk 1073741824" returned: 0 in 0.056s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "1c2393b0eda040c3bbcefcec18c22b3dea826fa6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6 --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG nova.objects.instance [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'migration_context' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:54 user nova-compute[75305]: DEBUG nova.objects.base [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<888926e8-0eea-4900-98cf-968133edcfab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:17:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Rebasing disk image.
Nov 14 08:17:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 -F raw /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:17:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 -F raw /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk" returned: 0 in 2.394s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Ensure instance console log exists: /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Start _get_guest_xml network_info=[{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='98509733c09d36b2bceebd237ef1ed47',container_format='bare',created_at=2023-11-14T08:15:57Z,direct_url=<?>,disk_format='qcow2',id=ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1368613915-shelved',owner='7be86f7bfa9f4566a035ca96314ac1c7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T08:16:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:17:57 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:17:57 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='98509733c09d36b2bceebd237ef1ed47',container_format='bare',created_at=2023-11-14T08:15:57Z,direct_url=<?>,disk_format='qcow2',id=ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1368613915-shelved',owner='7be86f7bfa9f4566a035ca96314ac1c7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T08:16:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'vcpu_model' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.objects.base [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<888926e8-0eea-4900-98cf-968133edcfab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1368613915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1368613915',id=31,image_ref='ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-300441375',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-diqu32dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member',shelved_at='2023-11-14T08:16:01.498430',shelved_host='user',shelved_image_id='ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=888926e8-0eea-4900-98cf-968133edcfab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'pci_devices' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.objects.base [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Object Instance<888926e8-0eea-4900-98cf-968133edcfab> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:17:57 user nova-compute[75305]:   <uuid>888926e8-0eea-4900-98cf-968133edcfab</uuid>
Nov 14 08:17:57 user nova-compute[75305]:   <name>instance-0000001f</name>
Nov 14 08:17:57 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:17:57 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:17:57 user nova-compute[75305]:   <metadata>
Nov 14 08:17:57 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:17:57 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:17:57 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1368613915</nova:name>
Nov 14 08:17:57 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:17:57</nova:creationTime>
Nov 14 08:17:57 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:17:57 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:17:57 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:17:57 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:17:57 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:17:57 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:17:57 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:17:57 user nova-compute[75305]:       <nova:owner>
Nov 14 08:17:57 user nova-compute[75305]:         <nova:user uuid="084e1f8ee4db4391b2d545926f45e659">tempest-AttachVolumeShelveTestJSON-488426726-project-member</nova:user>
Nov 14 08:17:57 user nova-compute[75305]:         <nova:project uuid="7be86f7bfa9f4566a035ca96314ac1c7">tempest-AttachVolumeShelveTestJSON-488426726</nova:project>
Nov 14 08:17:57 user nova-compute[75305]:       </nova:owner>
Nov 14 08:17:57 user nova-compute[75305]:       <nova:root type="image" uuid="ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5"/>
Nov 14 08:17:57 user nova-compute[75305]:       <nova:ports>
Nov 14 08:17:57 user nova-compute[75305]:         <nova:port uuid="e0f27b62-3bdf-4058-9311-bd610be6b581">
Nov 14 08:17:57 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 08:17:57 user nova-compute[75305]:         </nova:port>
Nov 14 08:17:57 user nova-compute[75305]:       </nova:ports>
Nov 14 08:17:57 user nova-compute[75305]:     </nova:instance>
Nov 14 08:17:57 user nova-compute[75305]:   </metadata>
Nov 14 08:17:57 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:17:57 user nova-compute[75305]:     <system>
Nov 14 08:17:57 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:17:57 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:17:57 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:17:57 user nova-compute[75305]:       <entry name="serial">888926e8-0eea-4900-98cf-968133edcfab</entry>
Nov 14 08:17:57 user nova-compute[75305]:       <entry name="uuid">888926e8-0eea-4900-98cf-968133edcfab</entry>
Nov 14 08:17:57 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:17:57 user nova-compute[75305]:     </system>
Nov 14 08:17:57 user nova-compute[75305]:   </sysinfo>
Nov 14 08:17:57 user nova-compute[75305]:   <os>
Nov 14 08:17:57 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:17:57 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:17:57 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:17:57 user nova-compute[75305]:   </os>
Nov 14 08:17:57 user nova-compute[75305]:   <features>
Nov 14 08:17:57 user nova-compute[75305]:     <acpi/>
Nov 14 08:17:57 user nova-compute[75305]:     <apic/>
Nov 14 08:17:57 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:17:57 user nova-compute[75305]:   </features>
Nov 14 08:17:57 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:17:57 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:17:57 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:17:57 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:17:57 user nova-compute[75305]:   </clock>
Nov 14 08:17:57 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:17:57 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:17:57 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:17:57 user nova-compute[75305]:   </cpu>
Nov 14 08:17:57 user nova-compute[75305]:   <devices>
Nov 14 08:17:57 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:17:57 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:17:57 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk"/>
Nov 14 08:17:57 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:17:57 user nova-compute[75305]:     </disk>
Nov 14 08:17:57 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:17:57 user nova-compute[75305]:       <mac address="fa:16:3e:a8:5d:54"/>
Nov 14 08:17:57 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:17:57 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:17:57 user nova-compute[75305]:       <target dev="tape0f27b62-3b"/>
Nov 14 08:17:57 user nova-compute[75305]:     </interface>
Nov 14 08:17:57 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:17:57 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/console.log" append="off"/>
Nov 14 08:17:57 user nova-compute[75305]:     </serial>
Nov 14 08:17:57 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:17:57 user nova-compute[75305]:     <video>
Nov 14 08:17:57 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:17:57 user nova-compute[75305]:     </video>
Nov 14 08:17:57 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:17:57 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:17:57 user nova-compute[75305]:     </rng>
Nov 14 08:17:57 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:17:57 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:17:57 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:17:57 user nova-compute[75305]:     </memballoon>
Nov 14 08:17:57 user nova-compute[75305]:   </devices>
Nov 14 08:17:57 user nova-compute[75305]: </domain>
Nov 14 08:17:57 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1368613915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1368613915',id=31,image_ref='ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-300441375',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:14:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-diqu32dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member',shelved_at='2023-11-14T08:16:01.498430',shelved_host='user',shelved_image_id='ca67d7a9-6f8f-47dc-a3dd-f1a7e61379b5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:17:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=888926e8-0eea-4900-98cf-968133edcfab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG os_vif [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '898d2f90-57f8-54a3-b87a-4b759c09e73c', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0f27b62-3b, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0f27b62-3b, col_values=(('qos', UUID('68a3d00e-be23-4b59-87d7-79a652064b8a')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0f27b62-3b, col_values=(('external_ids', {'iface-id': 'e0f27b62-3bdf-4058-9311-bd610be6b581', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:5d:54', 'vm-uuid': '888926e8-0eea-4900-98cf-968133edcfab'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:57 user nova-compute[75305]: INFO os_vif [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b')
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:17:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] No VIF found with MAC fa:16:3e:a8:5d:54, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:17:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-d8ce85f4-9d99-4f73-ba96-dd322a12ac03 req-b22089f2-e829-4e83-bcf0-46112ca94bca service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8ce85f4-9d99-4f73-ba96-dd322a12ac03 req-b22089f2-e829-4e83-bcf0-46112ca94bca service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8ce85f4-9d99-4f73-ba96-dd322a12ac03 req-b22089f2-e829-4e83-bcf0-46112ca94bca service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d8ce85f4-9d99-4f73-ba96-dd322a12ac03 req-b22089f2-e829-4e83-bcf0-46112ca94bca service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-d8ce85f4-9d99-4f73-ba96-dd322a12ac03 req-b22089f2-e829-4e83-bcf0-46112ca94bca service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:17:59 user nova-compute[75305]: WARNING nova.compute.manager [req-d8ce85f4-9d99-4f73-ba96-dd322a12ac03 req-b22089f2-e829-4e83-bcf0-46112ca94bca service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 08:17:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:17:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:18:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:18:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance spawned successfully.
Nov 14 08:18:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:18:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-7c36a7ef-32c4-4621-8425-4750ed5a0513 req-7a476017-8950-41a6-9f59-925e42b9cec6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:18:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7c36a7ef-32c4-4621-8425-4750ed5a0513 req-7a476017-8950-41a6-9f59-925e42b9cec6 service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7c36a7ef-32c4-4621-8425-4750ed5a0513 req-7a476017-8950-41a6-9f59-925e42b9cec6 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7c36a7ef-32c4-4621-8425-4750ed5a0513 req-7a476017-8950-41a6-9f59-925e42b9cec6 service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-7c36a7ef-32c4-4621-8425-4750ed5a0513 req-7a476017-8950-41a6-9f59-925e42b9cec6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:18:01 user nova-compute[75305]: WARNING nova.compute.manager [req-7c36a7ef-32c4-4621-8425-4750ed5a0513 req-7a476017-8950-41a6-9f59-925e42b9cec6 service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 08:18:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-df3b3348-b290-47ae-abbb-4473ceb02941 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.819s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "3704f134-c480-4849-9261-eb29c54024a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:18:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:18 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:18:18 user nova-compute[75305]: INFO nova.compute.claims [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Claim successful on node user
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:18:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.policy [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5997915995004b44ba724d220b5c46a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2478d3b11c2b41e580ffcc1d3a1215de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:18:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Creating image(s)
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "/opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "/opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "/opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk 1073741824" returned: 0 in 0.155s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Successfully created port: f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Cannot resize image /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Ensure instance console log exists: /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Successfully updated port: f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "refresh_cache-3704f134-c480-4849-9261-eb29c54024a7" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquired lock "refresh_cache-3704f134-c480-4849-9261-eb29c54024a7" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received event network-changed-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Refreshing instance network info cache due to event network-changed-f80715d7-e1a0-4372-acf3-bcc21035a69d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] Acquiring lock "refresh_cache-3704f134-c480-4849-9261-eb29c54024a7" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Updating instance_info_cache with network_info: [{"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Releasing lock "refresh_cache-3704f134-c480-4849-9261-eb29c54024a7" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Instance network_info: |[{"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] Acquired lock "refresh_cache-3704f134-c480-4849-9261-eb29c54024a7" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Refreshing network info cache for port f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Start _get_guest_xml network_info=[{"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:18:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:18:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:18:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-899060417',display_name='tempest-VolumesActionsTest-instance-899060417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-899060417',id=35,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2478d3b11c2b41e580ffcc1d3a1215de',ramdisk_id='',reservation_id='r-anaz08u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1814532565',owner_user_name='tempest-VolumesActionsTest-1814532565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:18:19Z,user_data=None,user_id='5997915995004b44ba724d220b5c46a0',uuid=3704f134-c480-4849-9261-eb29c54024a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converting VIF {"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f80715d7-e1a0-4372-acf3-bcc21035a69d,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80715d7-e1') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.objects.instance [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lazy-loading 'pci_devices' on Instance uuid 3704f134-c480-4849-9261-eb29c54024a7 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:18:21 user nova-compute[75305]:   <uuid>3704f134-c480-4849-9261-eb29c54024a7</uuid>
Nov 14 08:18:21 user nova-compute[75305]:   <name>instance-00000023</name>
Nov 14 08:18:21 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:18:21 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:18:21 user nova-compute[75305]:   <metadata>
Nov 14 08:18:21 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:18:21 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:18:21 user nova-compute[75305]:       <nova:name>tempest-VolumesActionsTest-instance-899060417</nova:name>
Nov 14 08:18:21 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:18:20</nova:creationTime>
Nov 14 08:18:21 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:18:21 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:18:21 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:18:21 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:18:21 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:18:21 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:18:21 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:18:21 user nova-compute[75305]:       <nova:owner>
Nov 14 08:18:21 user nova-compute[75305]:         <nova:user uuid="5997915995004b44ba724d220b5c46a0">tempest-VolumesActionsTest-1814532565-project-member</nova:user>
Nov 14 08:18:21 user nova-compute[75305]:         <nova:project uuid="2478d3b11c2b41e580ffcc1d3a1215de">tempest-VolumesActionsTest-1814532565</nova:project>
Nov 14 08:18:21 user nova-compute[75305]:       </nova:owner>
Nov 14 08:18:21 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:18:21 user nova-compute[75305]:       <nova:ports>
Nov 14 08:18:21 user nova-compute[75305]:         <nova:port uuid="f80715d7-e1a0-4372-acf3-bcc21035a69d">
Nov 14 08:18:21 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:18:21 user nova-compute[75305]:         </nova:port>
Nov 14 08:18:21 user nova-compute[75305]:       </nova:ports>
Nov 14 08:18:21 user nova-compute[75305]:     </nova:instance>
Nov 14 08:18:21 user nova-compute[75305]:   </metadata>
Nov 14 08:18:21 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:18:21 user nova-compute[75305]:     <system>
Nov 14 08:18:21 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:18:21 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:18:21 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:18:21 user nova-compute[75305]:       <entry name="serial">3704f134-c480-4849-9261-eb29c54024a7</entry>
Nov 14 08:18:21 user nova-compute[75305]:       <entry name="uuid">3704f134-c480-4849-9261-eb29c54024a7</entry>
Nov 14 08:18:21 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:18:21 user nova-compute[75305]:     </system>
Nov 14 08:18:21 user nova-compute[75305]:   </sysinfo>
Nov 14 08:18:21 user nova-compute[75305]:   <os>
Nov 14 08:18:21 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:18:21 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:18:21 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:18:21 user nova-compute[75305]:   </os>
Nov 14 08:18:21 user nova-compute[75305]:   <features>
Nov 14 08:18:21 user nova-compute[75305]:     <acpi/>
Nov 14 08:18:21 user nova-compute[75305]:     <apic/>
Nov 14 08:18:21 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:18:21 user nova-compute[75305]:   </features>
Nov 14 08:18:21 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:18:21 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:18:21 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:18:21 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:18:21 user nova-compute[75305]:   </clock>
Nov 14 08:18:21 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:18:21 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:18:21 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:18:21 user nova-compute[75305]:   </cpu>
Nov 14 08:18:21 user nova-compute[75305]:   <devices>
Nov 14 08:18:21 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:18:21 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:18:21 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk"/>
Nov 14 08:18:21 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:18:21 user nova-compute[75305]:     </disk>
Nov 14 08:18:21 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:18:21 user nova-compute[75305]:       <mac address="fa:16:3e:85:84:5d"/>
Nov 14 08:18:21 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:18:21 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:18:21 user nova-compute[75305]:       <target dev="tapf80715d7-e1"/>
Nov 14 08:18:21 user nova-compute[75305]:     </interface>
Nov 14 08:18:21 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:18:21 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/console.log" append="off"/>
Nov 14 08:18:21 user nova-compute[75305]:     </serial>
Nov 14 08:18:21 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:18:21 user nova-compute[75305]:     <video>
Nov 14 08:18:21 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:18:21 user nova-compute[75305]:     </video>
Nov 14 08:18:21 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:18:21 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:18:21 user nova-compute[75305]:     </rng>
Nov 14 08:18:21 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:18:21 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:18:21 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:18:21 user nova-compute[75305]:     </memballoon>
Nov 14 08:18:21 user nova-compute[75305]:   </devices>
Nov 14 08:18:21 user nova-compute[75305]: </domain>
Nov 14 08:18:21 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-899060417',display_name='tempest-VolumesActionsTest-instance-899060417',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-899060417',id=35,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2478d3b11c2b41e580ffcc1d3a1215de',ramdisk_id='',reservation_id='r-anaz08u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1814532565',owner_user_name='tempest-VolumesActionsTest-1814532565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:18:19Z,user_data=None,user_id='5997915995004b44ba724d220b5c46a0',uuid=3704f134-c480-4849-9261-eb29c54024a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converting VIF {"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f80715d7-e1a0-4372-acf3-bcc21035a69d,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80715d7-e1') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG os_vif [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f80715d7-e1a0-4372-acf3-bcc21035a69d,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80715d7-e1') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31cac6c4-d9d5-557d-9fa0-776b67905e5e', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf80715d7-e1, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf80715d7-e1, col_values=(('qos', UUID('0b840a00-2390-4135-ac44-149c6dd9748b')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf80715d7-e1, col_values=(('external_ids', {'iface-id': 'f80715d7-e1a0-4372-acf3-bcc21035a69d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:84:5d', 'vm-uuid': '3704f134-c480-4849-9261-eb29c54024a7'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:21 user nova-compute[75305]: INFO os_vif [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f80715d7-e1a0-4372-acf3-bcc21035a69d,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80715d7-e1')
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] No VIF found with MAC fa:16:3e:85:84:5d, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.network.neutron [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Updated VIF entry in instance network info cache for port f80715d7-e1a0-4372-acf3-bcc21035a69d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG nova.network.neutron [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Updating instance_info_cache with network_info: [{"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:18:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-968d692d-e78d-4229-9899-26ab68a9e0f6 req-128efa7d-c488-4acf-a093-a2c4e85fd318 service nova] Releasing lock "refresh_cache-3704f134-c480-4849-9261-eb29c54024a7" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-13d18b3c-007e-4880-b4ed-60ff53bf5ef7 req-57a66a3f-ec0a-4469-8b1c-9fdafbe4243f service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received event network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13d18b3c-007e-4880-b4ed-60ff53bf5ef7 req-57a66a3f-ec0a-4469-8b1c-9fdafbe4243f service nova] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13d18b3c-007e-4880-b4ed-60ff53bf5ef7 req-57a66a3f-ec0a-4469-8b1c-9fdafbe4243f service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13d18b3c-007e-4880-b4ed-60ff53bf5ef7 req-57a66a3f-ec0a-4469-8b1c-9fdafbe4243f service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-13d18b3c-007e-4880-b4ed-60ff53bf5ef7 req-57a66a3f-ec0a-4469-8b1c-9fdafbe4243f service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] No waiting events found dispatching network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:18:22 user nova-compute[75305]: WARNING nova.compute.manager [req-13d18b3c-007e-4880-b4ed-60ff53bf5ef7 req-57a66a3f-ec0a-4469-8b1c-9fdafbe4243f service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received unexpected event network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d for instance with vm_state building and task_state spawning.
Nov 14 08:18:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:18:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:18:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Instance spawned successfully.
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:24 user nova-compute[75305]: INFO nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-464151ea-26be-4efd-a73c-b3672554f37f req-d2de6e79-13dd-4835-9ad4-9832c932bb78 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received event network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-464151ea-26be-4efd-a73c-b3672554f37f req-d2de6e79-13dd-4835-9ad4-9832c932bb78 service nova] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-464151ea-26be-4efd-a73c-b3672554f37f req-d2de6e79-13dd-4835-9ad4-9832c932bb78 service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-464151ea-26be-4efd-a73c-b3672554f37f req-d2de6e79-13dd-4835-9ad4-9832c932bb78 service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-464151ea-26be-4efd-a73c-b3672554f37f req-d2de6e79-13dd-4835-9ad4-9832c932bb78 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] No waiting events found dispatching network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:18:24 user nova-compute[75305]: WARNING nova.compute.manager [req-464151ea-26be-4efd-a73c-b3672554f37f req-d2de6e79-13dd-4835-9ad4-9832c932bb78 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received unexpected event network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d for instance with vm_state building and task_state spawning.
Nov 14 08:18:25 user nova-compute[75305]: INFO nova.compute.manager [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Took 6.22 seconds to build instance.
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-bafb2b61-9e52-4d90-a082-f533fccfa05d tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "3704f134-c480-4849-9261-eb29c54024a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.335s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:18:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:27 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:18:27 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=24.952510833740234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 961e2d61-c567-4861-974f-7cd205244bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5b229490-ec43-495b-88f4-b829dd71c07b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 888926e8-0eea-4900-98cf-968133edcfab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 3704f134-c480-4849-9261-eb29c54024a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:18:27 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:18:28 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:18:28 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:18:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:18:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.715s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:28 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [{"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-961e2d61-c567-4861-974f-7cd205244bee" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:18:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:18:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:18:43 user nova-compute[75305]: INFO nova.compute.claims [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Claim successful on node user
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.network.neutron [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:18:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:18:43 user nova-compute[75305]: DEBUG nova.policy [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74b6bdb955524015ad1aec74ee466957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f92869b8c2e246ca8f9d361c8ecabac0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:18:43 user nova-compute[75305]: INFO nova.virt.block_device [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Booting with volume-backed-image 5d88aadf-7386-48ab-8524-9b99a75f107c at /dev/vda
Nov 14 08:18:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Successfully created port: 22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Successfully updated port: 22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-changed-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Refreshing instance network info cache due to event network-changed-22af325a-a511-4313-a09e-4d0804a62b0b. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] Acquiring lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:18:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Updating instance_info_cache with network_info: [{"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance network_info: |[{"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] Acquired lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Refreshing network info cache for port 22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Updated VIF entry in instance network info cache for port 22af325a-a511-4313-a09e-4d0804a62b0b. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Updating instance_info_cache with network_info: [{"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-df0596d0-c1d4-451a-89a8-f9aff06edc66 req-2029496b-d27b-44be-b6e0-dd9b3fce1dff service nova] Releasing lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:18:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG os_brick.utils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc526cbc-a945-4c26-af22-329ed6922a1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[98712078-2267-4c42-8cc0-f0ac0ded4e37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[26307361-d9f0-4916-b6f7-76a794fa0d98]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d23482e-0ecf-4306-9ba4-1454d9db8306]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:18:49 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:18:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[df324f21-8740-4343-991f-2f0afe1d229a]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG os_brick.utils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:18:49 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Updating existing volume attachment record: 12b60420-ba0a-4003-907a-ad7870eea66f {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:18:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:18:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Creating image(s)
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Ensure instance console log exists: /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Start _get_guest_xml network_info=[{"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '12b60420-ba0a-4003-907a-ad7870eea66f', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raVmMnJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64b4867a-3fba-49db-b4c7-2a92bfa4d0a5', 'attached_at': '', 'detached_at': '', 'volume_id': '0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'serial': '0bd001b4-ad73-4c2a-8e0a-d273df7dbe68'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:18:54 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:18:54 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raVmMnJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:18:54 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:18:54 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:18:54 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad98685-cc93-441a-b7ee-4a7320c62412]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:18:54 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c2bbe7-f653-4c90-a835-f85311c65a56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68] added
Nov 14 08:18:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22417627-0274-4998-97cd-d780a889fe5b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9577c2-0e15-419f-8424-0d88a729d37a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raVmMnJb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raVmMnJb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a743a2-868b-43e8-a099-2ef690159a95]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'raVmMnJb'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da3478b-6474-48c0-8957-64dc458a8d7f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5a8d05-e561-4d78-82b2-4b734a11c75d]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:18:54 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:18:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:18:54 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:18:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[178bc2da-800a-4199-b5f8-bcc85708eaf0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260]
Nov 14 08:18:54 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260] successful.
Nov 14 08:18:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[198055fd-6306-4eac-89f2-3b97359c2541]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89efa800-8de5-4905-9464-66c7c9f3c079]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:18:54 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:18:54 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:18:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:18:54 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:18:54 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:18:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe837a4-9b97-4eb6-aeab-f4b6eaca7ee2]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raVmMnJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:18:54 user nova-compute[75305]: WARNING nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid d16d469c-6caf-4ba0-869e-2eb0c4908d24 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 961e2d61-c567-4861-974f-7cd205244bee {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 36cc9bba-70f0-4bcd-bf54-81cfd335f797 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 5b229490-ec43-495b-88f4-b829dd71c07b {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 3704f134-c480-4849-9261-eb29c54024a7 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "f5e23822-868e-4437-b87b-487179175d6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "961e2d61-c567-4861-974f-7cd205244bee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "3704f134-c480-4849-9261-eb29c54024a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "888926e8-0eea-4900-98cf-968133edcfab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "f5e23822-868e-4437-b87b-487179175d6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "961e2d61-c567-4861-974f-7cd205244bee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "3704f134-c480-4849-9261-eb29c54024a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "888926e8-0eea-4900-98cf-968133edcfab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23933646337653639', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933646337653639', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1507680698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1507680698',id=36,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-a5s8xoyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:18:44Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=64b4867a-3fba-49db-b4c7-2a92bfa4d0a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.objects.instance [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'pci_devices' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:18:55 user nova-compute[75305]:   <uuid>64b4867a-3fba-49db-b4c7-2a92bfa4d0a5</uuid>
Nov 14 08:18:55 user nova-compute[75305]:   <name>instance-00000024</name>
Nov 14 08:18:55 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:18:55 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:18:55 user nova-compute[75305]:   <metadata>
Nov 14 08:18:55 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:18:55 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:18:55 user nova-compute[75305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1507680698</nova:name>
Nov 14 08:18:55 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:18:54</nova:creationTime>
Nov 14 08:18:55 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:18:55 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:18:55 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:18:55 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:18:55 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:18:55 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:18:55 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:18:55 user nova-compute[75305]:       <nova:owner>
Nov 14 08:18:55 user nova-compute[75305]:         <nova:user uuid="74b6bdb955524015ad1aec74ee466957">tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member</nova:user>
Nov 14 08:18:55 user nova-compute[75305]:         <nova:project uuid="f92869b8c2e246ca8f9d361c8ecabac0">tempest-ServerBootFromVolumeStableRescueTest-983718269</nova:project>
Nov 14 08:18:55 user nova-compute[75305]:       </nova:owner>
Nov 14 08:18:55 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:18:55 user nova-compute[75305]:       <nova:ports>
Nov 14 08:18:55 user nova-compute[75305]:         <nova:port uuid="22af325a-a511-4313-a09e-4d0804a62b0b">
Nov 14 08:18:55 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 08:18:55 user nova-compute[75305]:         </nova:port>
Nov 14 08:18:55 user nova-compute[75305]:       </nova:ports>
Nov 14 08:18:55 user nova-compute[75305]:     </nova:instance>
Nov 14 08:18:55 user nova-compute[75305]:   </metadata>
Nov 14 08:18:55 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:18:55 user nova-compute[75305]:     <system>
Nov 14 08:18:55 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:18:55 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:18:55 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:18:55 user nova-compute[75305]:       <entry name="serial">64b4867a-3fba-49db-b4c7-2a92bfa4d0a5</entry>
Nov 14 08:18:55 user nova-compute[75305]:       <entry name="uuid">64b4867a-3fba-49db-b4c7-2a92bfa4d0a5</entry>
Nov 14 08:18:55 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:18:55 user nova-compute[75305]:     </system>
Nov 14 08:18:55 user nova-compute[75305]:   </sysinfo>
Nov 14 08:18:55 user nova-compute[75305]:   <os>
Nov 14 08:18:55 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:18:55 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:18:55 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:18:55 user nova-compute[75305]:   </os>
Nov 14 08:18:55 user nova-compute[75305]:   <features>
Nov 14 08:18:55 user nova-compute[75305]:     <acpi/>
Nov 14 08:18:55 user nova-compute[75305]:     <apic/>
Nov 14 08:18:55 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:18:55 user nova-compute[75305]:   </features>
Nov 14 08:18:55 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:18:55 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:18:55 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:18:55 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:18:55 user nova-compute[75305]:   </clock>
Nov 14 08:18:55 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:18:55 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:18:55 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:18:55 user nova-compute[75305]:   </cpu>
Nov 14 08:18:55 user nova-compute[75305]:   <devices>
Nov 14 08:18:55 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:18:55 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:18:55 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:18:55 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:18:55 user nova-compute[75305]:       <serial>0bd001b4-ad73-4c2a-8e0a-d273df7dbe68</serial>
Nov 14 08:18:55 user nova-compute[75305]:     </disk>
Nov 14 08:18:55 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:18:55 user nova-compute[75305]:       <mac address="fa:16:3e:b5:b1:38"/>
Nov 14 08:18:55 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:18:55 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:18:55 user nova-compute[75305]:       <target dev="tap22af325a-a5"/>
Nov 14 08:18:55 user nova-compute[75305]:     </interface>
Nov 14 08:18:55 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:18:55 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/console.log" append="off"/>
Nov 14 08:18:55 user nova-compute[75305]:     </serial>
Nov 14 08:18:55 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:18:55 user nova-compute[75305]:     <video>
Nov 14 08:18:55 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:18:55 user nova-compute[75305]:     </video>
Nov 14 08:18:55 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:18:55 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:18:55 user nova-compute[75305]:     </rng>
Nov 14 08:18:55 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:18:55 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:18:55 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:18:55 user nova-compute[75305]:     </memballoon>
Nov 14 08:18:55 user nova-compute[75305]:   </devices>
Nov 14 08:18:55 user nova-compute[75305]: </domain>
Nov 14 08:18:55 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1507680698',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1507680698',id=36,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-a5s8xoyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:18:44Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=64b4867a-3fba-49db-b4c7-2a92bfa4d0a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG os_vif [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '916e07ea-f340-527d-97cd-e1219e58be03', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22af325a-a5, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22af325a-a5, col_values=(('qos', UUID('a0b16085-3e2d-400f-8a4d-6e8731d45950')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22af325a-a5, col_values=(('external_ids', {'iface-id': '22af325a-a511-4313-a09e-4d0804a62b0b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:b1:38', 'vm-uuid': '64b4867a-3fba-49db-b4c7-2a92bfa4d0a5'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:55 user nova-compute[75305]: INFO os_vif [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5')
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:18:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No VIF found with MAC fa:16:3e:b5:b1:38, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:18:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-44f48f42-e819-4f8b-ba99-9e57b7a8a496 req-136a80cc-38ca-4392-8488-ffc966d12c5d service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44f48f42-e819-4f8b-ba99-9e57b7a8a496 req-136a80cc-38ca-4392-8488-ffc966d12c5d service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44f48f42-e819-4f8b-ba99-9e57b7a8a496 req-136a80cc-38ca-4392-8488-ffc966d12c5d service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44f48f42-e819-4f8b-ba99-9e57b7a8a496 req-136a80cc-38ca-4392-8488-ffc966d12c5d service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-44f48f42-e819-4f8b-ba99-9e57b7a8a496 req-136a80cc-38ca-4392-8488-ffc966d12c5d service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:18:57 user nova-compute[75305]: WARNING nova.compute.manager [req-44f48f42-e819-4f8b-ba99-9e57b7a8a496 req-136a80cc-38ca-4392-8488-ffc966d12c5d service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state building and task_state spawning.
Nov 14 08:18:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:18:59 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance spawned successfully.
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:18:59 user nova-compute[75305]: INFO nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Took 5.17 seconds to spawn the instance on the hypervisor.
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-72185cad-7755-47c8-bb2f-b273c3363a8b req-6aabedd7-70e5-4f6c-90d1-33073fcf432e service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-72185cad-7755-47c8-bb2f-b273c3363a8b req-6aabedd7-70e5-4f6c-90d1-33073fcf432e service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-72185cad-7755-47c8-bb2f-b273c3363a8b req-6aabedd7-70e5-4f6c-90d1-33073fcf432e service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-72185cad-7755-47c8-bb2f-b273c3363a8b req-6aabedd7-70e5-4f6c-90d1-33073fcf432e service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-72185cad-7755-47c8-bb2f-b273c3363a8b req-6aabedd7-70e5-4f6c-90d1-33073fcf432e service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:18:59 user nova-compute[75305]: WARNING nova.compute.manager [req-72185cad-7755-47c8-bb2f-b273c3363a8b req-6aabedd7-70e5-4f6c-90d1-33073fcf432e service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state active and task_state None.
Nov 14 08:18:59 user nova-compute[75305]: INFO nova.compute.manager [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Took 16.27 seconds to build instance.
Nov 14 08:18:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33da5d2c-883d-405a-895b-b268dd81b41c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.382s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:18:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.840s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:18:59 user nova-compute[75305]: INFO nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 14 08:18:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:19:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:19:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:19:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:19:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:14 user nova-compute[75305]: INFO nova.compute.manager [None req-ca705b3a-35c2-492f-813f-e6a1d53cfb5d tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Get console output
Nov 14 08:19:14 user nova-compute[75305]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 08:19:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:20 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:20 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:19:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-changed-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Refreshing instance network info cache due to event network-changed-9e489d79-373d-49d1-aead-bf240bc0fe3c. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] Acquiring lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] Acquired lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Refreshing network info cache for port 9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:19:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:28 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:19:28 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=7980MB free_disk=24.961288452148438GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'flavor' on Instance uuid 5b229490-ec43-495b-88f4-b829dd71c07b {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updated VIF entry in instance network info cache for port 9e489d79-373d-49d1-aead-bf240bc0fe3c. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updating instance_info_cache with network_info: [{"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d71b0b9d-361f-4435-850c-385ff14772d2 req-45b49f75-b683-4402-acd8-951e88209d0f service nova] Releasing lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 961e2d61-c567-4861-974f-7cd205244bee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5b229490-ec43-495b-88f4-b829dd71c07b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 888926e8-0eea-4900-98cf-968133edcfab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 3704f134-c480-4849-9261-eb29c54024a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:28 user nova-compute[75305]: INFO nova.compute.manager [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Attaching volume 4892b0df-f75b-4fc8-97cb-8e75e4180df2 to /dev/vdb
Nov 14 08:19:28 user nova-compute[75305]: DEBUG os_brick.utils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac1dd78-534c-4dfd-addb-f2ddcac35c15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[667bf934-e03f-41d6-8d24-f564f8aacc0c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be950c2d-0598-47a0-a5a0-a0630980fff7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[022eecf8-c2a8-4a30-a5ef-58a240eef264]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:19:28 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e66eb54-b077-40a8-9f48-e66448831679]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG os_brick.utils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updating existing volume attachment record: 55b1b2ec-6909-48d3-838f-e4926262ffb9 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:19:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:19:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:19:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:19:31 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [{"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:19:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-888926e8-0eea-4900-98cf-968133edcfab" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:19:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:19:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZlyTgnt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:19:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:19:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.013s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:19:32 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be6cf46-ab45-4ace-aa47-35a3b1be9355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:19:32 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a8e28e-de89-420d-8cb7-c5bd10ccdf5f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2] added
Nov 14 08:19:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a685cf-e6e8-4264-865a-1ce754843ea4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9fac73-6362-44bc-a47b-d1a07690acad]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZlyTgnt {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZlyTgnt" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[933f3c81-84ab-492d-9ed0-daec167eb98c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZlyTgnt'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5633d477-6ed9-4a88-92bf-216773af43b0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[456f6024-4c71-4c4a-a5be-11493fe776c7]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4bcb3b-bd8a-4004-9874-6ea8db9ffd5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260]
Nov 14 08:19:32 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260] successful.
Nov 14 08:19:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f659f42f-a460-4bef-8414-c3db2d60c61b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef34153-9393-4ccb-a2d2-017b2c06bb60]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 (non-flash)
Nov 14 08:19:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac9b0a-cf88-47cf-839e-e58e125f6fb1]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:19:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZlyTgnt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:19:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:19:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23761363234373836', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:19:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761363234373836', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:19:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'flavor' on Instance uuid 5b229490-ec43-495b-88f4-b829dd71c07b {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:19:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:19:34 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:19:34 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:19:34 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:19:34 user nova-compute[75305]:   <serial>4892b0df-f75b-4fc8-97cb-8e75e4180df2</serial>
Nov 14 08:19:34 user nova-compute[75305]: </disk>
Nov 14 08:19:34 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:19:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:19:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:19:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No VIF found with MAC fa:16:3e:96:43:df, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:19:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e10a6f66-d909-41ea-80ef-9ee62af76833 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.218s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:36 user nova-compute[75305]: INFO nova.compute.manager [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Detaching volume 4892b0df-f75b-4fc8-97cb-8e75e4180df2
Nov 14 08:19:36 user nova-compute[75305]: INFO nova.virt.block_device [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Attempting to driver detach volume 4892b0df-f75b-4fc8-97cb-8e75e4180df2 from mountpoint /dev/vdb
Nov 14 08:19:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Attempting to detach device vdb from instance 5b229490-ec43-495b-88f4-b829dd71c07b from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:19:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:19:36 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:19:36 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:19:36 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:19:36 user nova-compute[75305]:   <serial>4892b0df-f75b-4fc8-97cb-8e75e4180df2</serial>
Nov 14 08:19:36 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:19:36 user nova-compute[75305]: </disk>
Nov 14 08:19:36 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:19:36 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully detached device vdb from instance 5b229490-ec43-495b-88f4-b829dd71c07b from the persistent domain config.
Nov 14 08:19:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b229490-ec43-495b-88f4-b829dd71c07b from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:19:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:19:36 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:19:36 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:19:36 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:19:36 user nova-compute[75305]:   <serial>4892b0df-f75b-4fc8-97cb-8e75e4180df2</serial>
Nov 14 08:19:36 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:19:36 user nova-compute[75305]: </disk>
Nov 14 08:19:36 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:19:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b229490-ec43-495b-88f4-b829dd71c07b {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:19:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:40 user nova-compute[75305]: INFO nova.compute.manager [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Terminating instance
Nov 14 08:19:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2cae694-50bd-4806-9af7-743be5e50156 req-e29b30ad-2871-4850-9eb1-8e4a59d531ec service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2cae694-50bd-4806-9af7-743be5e50156 req-e29b30ad-2871-4850-9eb1-8e4a59d531ec service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2cae694-50bd-4806-9af7-743be5e50156 req-e29b30ad-2871-4850-9eb1-8e4a59d531ec service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2cae694-50bd-4806-9af7-743be5e50156 req-e29b30ad-2871-4850-9eb1-8e4a59d531ec service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2cae694-50bd-4806-9af7-743be5e50156 req-e29b30ad-2871-4850-9eb1-8e4a59d531ec service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2cae694-50bd-4806-9af7-743be5e50156 req-e29b30ad-2871-4850-9eb1-8e4a59d531ec service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Instance destroyed successfully.
Nov 14 08:19:41 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lazy-loading 'resources' on Instance uuid 888926e8-0eea-4900-98cf-968133edcfab {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1368613915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1368613915',id=31,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbwQrOK1QlSZE6X9q8X1qCTf/gx8bD3GXyvl57doyWYQp50KgqQvUBKaoJz29uESl1iUVmTxK/3HfdjqW8RDxaQT9FjAJKojDLe2G76ZMiK6Z1z6yBB3F3wE5dLjd2D0g==',key_name='tempest-keypair-300441375',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:18:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7be86f7bfa9f4566a035ca96314ac1c7',ramdisk_id='',reservation_id='r-diqu32dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-488426726',owner_user_name='tempest-AttachVolumeShelveTestJSON-488426726-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='084e1f8ee4db4391b2d545926f45e659',uuid=888926e8-0eea-4900-98cf-968133edcfab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converting VIF {"id": "e0f27b62-3bdf-4058-9311-bd610be6b581", "address": "fa:16:3e:a8:5d:54", "network": {"id": "3dbf63fa-88ea-445e-99dd-796dba8eb575", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1586335397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7be86f7bfa9f4566a035ca96314ac1c7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0f27b62-3b", "ovs_interfaceid": "e0f27b62-3bdf-4058-9311-bd610be6b581", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG os_vif [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0f27b62-3b, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68a3d00e-be23-4b59-87d7-79a652064b8a) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:19:41 user nova-compute[75305]: INFO os_vif [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:5d:54,bridge_name='br-int',has_traffic_filtering=True,id=e0f27b62-3bdf-4058-9311-bd610be6b581,network=Network(3dbf63fa-88ea-445e-99dd-796dba8eb575),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0f27b62-3b')
Nov 14 08:19:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Deleting instance files /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab_del
Nov 14 08:19:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Deletion of /opt/stack/data/nova/instances/888926e8-0eea-4900-98cf-968133edcfab_del complete
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: INFO nova.compute.manager [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 08:19:41 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:19:42 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Took 1.42 seconds to deallocate network for instance.
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:19:42 user nova-compute[75305]: WARNING nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state deleted and task_state None.
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:19:42 user nova-compute[75305]: WARNING nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state deleted and task_state None.
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:19:42 user nova-compute[75305]: WARNING nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state deleted and task_state None.
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:19:42 user nova-compute[75305]: WARNING nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-unplugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state deleted and task_state None.
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Acquiring lock "888926e8-0eea-4900-98cf-968133edcfab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] Lock "888926e8-0eea-4900-98cf-968133edcfab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] No waiting events found dispatching network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:19:42 user nova-compute[75305]: WARNING nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received unexpected event network-vif-plugged-e0f27b62-3bdf-4058-9311-bd610be6b581 for instance with vm_state deleted and task_state None.
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-04fa7f14-3186-4d29-a85b-634f892e99fa req-371a1278-c7a3-4cee-9796-38277d62a94f service nova] [instance: 888926e8-0eea-4900-98cf-968133edcfab] Received event network-vif-deleted-e0f27b62-3bdf-4058-9311-bd610be6b581 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:19:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:43 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Deleted allocations for instance 888926e8-0eea-4900-98cf-968133edcfab
Nov 14 08:19:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a069639a-a2ea-49b2-99ba-a39ee5eb37c2 tempest-AttachVolumeShelveTestJSON-488426726 tempest-AttachVolumeShelveTestJSON-488426726-project-member] Lock "888926e8-0eea-4900-98cf-968133edcfab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.628s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:19:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:19:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:19:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:19:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:19:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:19:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:19:57 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b229490-ec43-495b-88f4-b829dd71c07b is timed out.
Nov 14 08:19:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully detached device vdb from instance 5b229490-ec43-495b-88f4-b829dd71c07b from the live domain config.
Nov 14 08:19:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZlyTgnt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:19:57 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0916d2ff-ae75-4814-b546-a95b4f8bfbda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:19:57 user nova-compute[75305]: No targets found.
Nov 14 08:19:57 user nova-compute[75305]: iSNS:
Nov 14 08:19:57 user nova-compute[75305]: No targets found.
Nov 14 08:19:57 user nova-compute[75305]: STATIC:
Nov 14 08:19:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2
Nov 14 08:19:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:19:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:19:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68
Nov 14 08:19:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:19:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:19:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:19:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:19:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:19:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:19:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:19:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:19:57 user nova-compute[75305]: FIRMWARE:
Nov 14 08:19:57 user nova-compute[75305]: No targets found.
Nov 14 08:19:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:19:57 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:19:57 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d98ca5-99c9-484e-a031-a9135a6efa73]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9848337-7a75-47c9-815a-7c1bd4a8b039]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:19:57 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:19:57 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:19:57 user nova-compute[75305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 (non-flash)
Nov 14 08:19:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:19:57 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:19:57 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:19:57 user nova-compute[75305]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 (non-flash)
Nov 14 08:19:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf44312320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb54a66-14d1-4b9a-8052-46a2309be922]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde21520-7b18-484f-addc-17b956983847]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeed1c3-7281-4d11-83c3-d7ea77ab7023]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d023a5-7666-4264-a75b-e03fcc23577a]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ee5bb8-e806-4f01-90b0-f2b91a37efd6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d6d6b3-95b8-4b04-b974-4b2394e62bb7]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260]
Nov 14 08:19:57 user nova-compute[75305]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2, portal: 172.16.0.220,3260] successful.
Nov 14 08:19:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4892b0df-f75b-4fc8-97cb-8e75e4180df2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4cae85-2666-46d0-a67f-159e889fe0a8]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] <== disconnect_volume: return (347ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:19:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:19:58 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'flavor' on Instance uuid 5b229490-ec43-495b-88f4-b829dd71c07b {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:19:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9e276b33-36b0-4c91-9527-680899cab78e tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.736s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:19:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "3704f134-c480-4849-9261-eb29c54024a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:09 user nova-compute[75305]: INFO nova.compute.manager [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Terminating instance
Nov 14 08:20:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Instance destroyed successfully.
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lazy-loading 'resources' on Instance uuid 3704f134-c480-4849-9261-eb29c54024a7 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:18:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-899060417',display_name='tempest-VolumesActionsTest-instance-899060417',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-899060417',id=35,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:18:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2478d3b11c2b41e580ffcc1d3a1215de',ramdisk_id='',reservation_id='r-anaz08u4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1814532565',owner_user_name='tempest-VolumesActionsTest-1814532565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:18:25Z,user_data=None,user_id='5997915995004b44ba724d220b5c46a0',uuid=3704f134-c480-4849-9261-eb29c54024a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converting VIF {"id": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "address": "fa:16:3e:85:84:5d", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf80715d7-e1", "ovs_interfaceid": "f80715d7-e1a0-4372-acf3-bcc21035a69d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f80715d7-e1a0-4372-acf3-bcc21035a69d,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80715d7-e1') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG os_vif [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f80715d7-e1a0-4372-acf3-bcc21035a69d,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80715d7-e1') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf80715d7-e1, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b840a00-2390-4135-ac44-149c6dd9748b) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:10 user nova-compute[75305]: INFO os_vif [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:84:5d,bridge_name='br-int',has_traffic_filtering=True,id=f80715d7-e1a0-4372-acf3-bcc21035a69d,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf80715d7-e1')
Nov 14 08:20:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Deleting instance files /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7_del
Nov 14 08:20:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Deletion of /opt/stack/data/nova/instances/3704f134-c480-4849-9261-eb29c54024a7_del complete
Nov 14 08:20:10 user nova-compute[75305]: INFO nova.compute.manager [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 08:20:10 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 3704f134-c480-4849-9261-eb29c54024a7] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-da1c189a-bbde-4423-8880-5300f6ae1f9b req-b20260b3-7b5c-4787-a88c-b4adea4e3566 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received event network-vif-unplugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-da1c189a-bbde-4423-8880-5300f6ae1f9b req-b20260b3-7b5c-4787-a88c-b4adea4e3566 service nova] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-da1c189a-bbde-4423-8880-5300f6ae1f9b req-b20260b3-7b5c-4787-a88c-b4adea4e3566 service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-da1c189a-bbde-4423-8880-5300f6ae1f9b req-b20260b3-7b5c-4787-a88c-b4adea4e3566 service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-da1c189a-bbde-4423-8880-5300f6ae1f9b req-b20260b3-7b5c-4787-a88c-b4adea4e3566 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] No waiting events found dispatching network-vif-unplugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-da1c189a-bbde-4423-8880-5300f6ae1f9b req-b20260b3-7b5c-4787-a88c-b4adea4e3566 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received event network-vif-unplugged-f80715d7-e1a0-4372-acf3-bcc21035a69d for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:20:10 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Took 0.61 seconds to deallocate network for instance.
Nov 14 08:20:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-037d2c50-825f-4cea-93c8-b9a1bfe459cc req-becfd421-00cb-463e-b6f2-2a139cf51834 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received event network-vif-deleted-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:11 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:20:11 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:20:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:11 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Deleted allocations for instance 3704f134-c480-4849-9261-eb29c54024a7
Nov 14 08:20:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6be1a424-cc95-4799-a398-9c32fbb5a7d4 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "3704f134-c480-4849-9261-eb29c54024a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.887s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-00a28a56-c234-403e-bf10-f4bd11b01b98 req-5a152d83-4b86-48c4-af2f-124a7ffaca23 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received event network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-00a28a56-c234-403e-bf10-f4bd11b01b98 req-5a152d83-4b86-48c4-af2f-124a7ffaca23 service nova] Acquiring lock "3704f134-c480-4849-9261-eb29c54024a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-00a28a56-c234-403e-bf10-f4bd11b01b98 req-5a152d83-4b86-48c4-af2f-124a7ffaca23 service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-00a28a56-c234-403e-bf10-f4bd11b01b98 req-5a152d83-4b86-48c4-af2f-124a7ffaca23 service nova] Lock "3704f134-c480-4849-9261-eb29c54024a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-00a28a56-c234-403e-bf10-f4bd11b01b98 req-5a152d83-4b86-48c4-af2f-124a7ffaca23 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] No waiting events found dispatching network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:12 user nova-compute[75305]: WARNING nova.compute.manager [req-00a28a56-c234-403e-bf10-f4bd11b01b98 req-5a152d83-4b86-48c4-af2f-124a7ffaca23 service nova] [instance: 3704f134-c480-4849-9261-eb29c54024a7] Received unexpected event network-vif-plugged-f80715d7-e1a0-4372-acf3-bcc21035a69d for instance with vm_state deleted and task_state None.
Nov 14 08:20:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:14 user nova-compute[75305]: INFO nova.compute.manager [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Terminating instance
Nov 14 08:20:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-1b15c5f4-ccfa-469a-b42d-b9c2943169b5 req-4857b90c-e562-47cd-a51a-920c6283d408 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1b15c5f4-ccfa-469a-b42d-b9c2943169b5 req-4857b90c-e562-47cd-a51a-920c6283d408 service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1b15c5f4-ccfa-469a-b42d-b9c2943169b5 req-4857b90c-e562-47cd-a51a-920c6283d408 service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1b15c5f4-ccfa-469a-b42d-b9c2943169b5 req-4857b90c-e562-47cd-a51a-920c6283d408 service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-1b15c5f4-ccfa-469a-b42d-b9c2943169b5 req-4857b90c-e562-47cd-a51a-920c6283d408 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-1b15c5f4-ccfa-469a-b42d-b9c2943169b5 req-4857b90c-e562-47cd-a51a-920c6283d408 service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Instance destroyed successfully.
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'resources' on Instance uuid 961e2d61-c567-4861-974f-7cd205244bee {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:13:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1141013763',display_name='tempest-ServerActionsTestOtherA-server-1141013763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1141013763',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:15:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-37g09cai',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:17:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=961e2d61-c567-4861-974f-7cd205244bee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a93393fb-68b8-4ff0-a390-517a385f6c92", "address": "fa:16:3e:00:13:cc", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa93393fb-68", "ovs_interfaceid": "a93393fb-68b8-4ff0-a390-517a385f6c92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_vif [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa93393fb-68, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a38e79ee-38b8-4ff7-99bf-1194aedab3f0) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:15 user nova-compute[75305]: INFO os_vif [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:13:cc,bridge_name='br-int',has_traffic_filtering=True,id=a93393fb-68b8-4ff0-a390-517a385f6c92,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa93393fb-68')
Nov 14 08:20:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wvZTPxIK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:20:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51c5a71-eabd-45c1-8040-9a62ec99195c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:20:15 user nova-compute[75305]: No targets found.
Nov 14 08:20:15 user nova-compute[75305]: iSNS:
Nov 14 08:20:15 user nova-compute[75305]: No targets found.
Nov 14 08:20:15 user nova-compute[75305]: STATIC:
Nov 14 08:20:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68
Nov 14 08:20:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:20:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:20:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:20:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:20:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:20:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b
Nov 14 08:20:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:20:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:20:15 user nova-compute[75305]: FIRMWARE:
Nov 14 08:20:15 user nova-compute[75305]: No targets found.
Nov 14 08:20:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:20:15 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:20:15 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f95d0ea-250c-4885-b853-a082996bd718]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee26ccf3-af29-4d37-92ca-2559a3b557a9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:20:15 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:20:15 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:20:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:20:15 user nova-compute[75305]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b (non-flash)
Nov 14 08:20:15 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:20:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf44289fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489992d-12b7-4ad6-bbc6-8c7bcb85d01a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f790d4c-aaf0-4b8a-b684-30647e8e7c61]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daf6a9a-e390-4b94-91af-c5aeb0b15343]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:20:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db46fe4-cfee-48f0-b5aa-387b308fb373]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d67eb9-74ea-4a7b-9212-194cf36c6294]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1289e-17f9-4a66-a528-8f119cc21450]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260]
Nov 14 08:20:16 user nova-compute[75305]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b, portal: 172.16.0.220,3260] successful.
Nov 14 08:20:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9f10f8c-67dd-4327-b9d9-13d80279f96b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a76701-7b95-481f-a6b7-ec9128a24c87]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] <== disconnect_volume: return (345ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:20:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Deleting instance files /opt/stack/data/nova/instances/961e2d61-c567-4861-974f-7cd205244bee_del
Nov 14 08:20:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Deletion of /opt/stack/data/nova/instances/961e2d61-c567-4861-974f-7cd205244bee_del complete
Nov 14 08:20:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:16 user nova-compute[75305]: INFO nova.compute.manager [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 14 08:20:16 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:20:16 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:20:17 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Took 0.77 seconds to deallocate network for instance.
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-4f69655e-6e5e-4131-979a-848232da0d62 req-79282510-2d22-4f81-b2bb-edeb0cfb80fb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-deleted-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:17 user nova-compute[75305]: INFO nova.compute.manager [req-4f69655e-6e5e-4131-979a-848232da0d62 req-79282510-2d22-4f81-b2bb-edeb0cfb80fb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Neutron deleted interface a93393fb-68b8-4ff0-a390-517a385f6c92; detaching it from the instance and deleting it from the info cache
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.network.neutron [req-4f69655e-6e5e-4131-979a-848232da0d62 req-79282510-2d22-4f81-b2bb-edeb0cfb80fb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-4f69655e-6e5e-4131-979a-848232da0d62 req-79282510-2d22-4f81-b2bb-edeb0cfb80fb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Detach interface failed, port_id=a93393fb-68b8-4ff0-a390-517a385f6c92, reason: Instance 961e2d61-c567-4861-974f-7cd205244bee could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:17 user nova-compute[75305]: WARNING nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state active and task_state deleting.
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:17 user nova-compute[75305]: WARNING nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state active and task_state deleting.
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:17 user nova-compute[75305]: WARNING nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state active and task_state deleting.
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-unplugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Acquiring lock "961e2d61-c567-4861-974f-7cd205244bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] Lock "961e2d61-c567-4861-974f-7cd205244bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] No waiting events found dispatching network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:17 user nova-compute[75305]: WARNING nova.compute.manager [req-95ae7368-001a-4172-9ad5-c8867a1fd016 req-a0759a6b-7f9f-4963-bca6-36b9960551bb service nova] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Received unexpected event network-vif-plugged-a93393fb-68b8-4ff0-a390-517a385f6c92 for instance with vm_state active and task_state deleting.
Nov 14 08:20:17 user nova-compute[75305]: INFO nova.compute.manager [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 08:20:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 961e2d61-c567-4861-974f-7cd205244bee] Deleting volume: b9f10f8c-67dd-4327-b9d9-13d80279f96b {{(pid=75305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:18 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:20:18 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:20:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:18 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Deleted allocations for instance 961e2d61-c567-4861-974f-7cd205244bee
Nov 14 08:20:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fca23014-a00d-4839-8258-0f848587bc73 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "961e2d61-c567-4861-974f-7cd205244bee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.250s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:20 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:20:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:22 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:20:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:20:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:20:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:27 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:20:28 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:20:28 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.015296936035156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5b229490-ec43-495b-88f4-b829dd71c07b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:20:28 user nova-compute[75305]: INFO nova.compute.manager [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] instance snapshotting
Nov 14 08:20:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Beginning live snapshot process
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json -f qcow2 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json -f qcow2" returned: 0 in 0.163s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn6qkh232/4d8ba21b9bd04fd49507b906ce9a7c49.delta 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn6qkh232/4d8ba21b9bd04fd49507b906ce9a7c49.delta 1073741824" returned: 0 in 0.052s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 08:20:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75305) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 08:20:30 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 08:20:31 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:20:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn6qkh232/4d8ba21b9bd04fd49507b906ce9a7c49.delta /opt/stack/data/nova/instances/snapshots/tmpn6qkh232/4d8ba21b9bd04fd49507b906ce9a7c49 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn6qkh232/4d8ba21b9bd04fd49507b906ce9a7c49.delta /opt/stack/data/nova/instances/snapshots/tmpn6qkh232/4d8ba21b9bd04fd49507b906ce9a7c49" returned: 0 in 0.420s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:31 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Snapshot extracted, beginning image upload
Nov 14 08:20:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Snapshot image upload complete
Nov 14 08:20:33 user nova-compute[75305]: INFO nova.compute.manager [None req-4f41b7fd-8d71-4ccc-8ffb-f8e547bca88b tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Took 4.97 seconds to snapshot the instance on the hypervisor.
Nov 14 08:20:33 user nova-compute[75305]: INFO nova.compute.manager [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Rescuing
Nov 14 08:20:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:20:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:20:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Updating instance_info_cache with network_info: [{"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4a86676-b87c-40c7-a153-9185ef8fb4e8 req-fd27c98e-9b6b-4c58-b52a-143e854e12c5 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4a86676-b87c-40c7-a153-9185ef8fb4e8 req-fd27c98e-9b6b-4c58-b52a-143e854e12c5 service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4a86676-b87c-40c7-a153-9185ef8fb4e8 req-fd27c98e-9b6b-4c58-b52a-143e854e12c5 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a4a86676-b87c-40c7-a153-9185ef8fb4e8 req-fd27c98e-9b6b-4c58-b52a-143e854e12c5 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-a4a86676-b87c-40c7-a153-9185ef8fb4e8 req-fd27c98e-9b6b-4c58-b52a-143e854e12c5 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:34 user nova-compute[75305]: WARNING nova.compute.manager [req-a4a86676-b87c-40c7-a153-9185ef8fb4e8 req-fd27c98e-9b6b-4c58-b52a-143e854e12c5 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state active and task_state rescuing.
Nov 14 08:20:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance destroyed successfully.
Nov 14 08:20:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Attempting a stable device rescue
Nov 14 08:20:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 08:20:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:20:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Creating image(s)
Nov 14 08:20:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "/opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "/opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:35 user nova-compute[75305]: DEBUG nova.objects.instance [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "fbaf45db8b1c9b3927aeb14612dafa77722ae848" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "fbaf45db8b1c9b3927aeb14612dafa77722ae848" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG nova.virt.images [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] c5bbbc39-096e-457c-8459-913d303df308 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.part /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:20:36 user nova-compute[75305]: INFO nova.compute.claims [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Claim successful on node user
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.part /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.converted" returned: 0 in 0.361s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "fbaf45db8b1c9b3927aeb14612dafa77722ae848" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "fbaf45db8b1c9b3927aeb14612dafa77722ae848" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "fbaf45db8b1c9b3927aeb14612dafa77722ae848" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-2062a92a-f18f-4272-9aa7-48fbf2149406 req-b24032d4-afe0-43ff-9dc5-042e4aff3cd6 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2062a92a-f18f-4272-9aa7-48fbf2149406 req-b24032d4-afe0-43ff-9dc5-042e4aff3cd6 service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2062a92a-f18f-4272-9aa7-48fbf2149406 req-b24032d4-afe0-43ff-9dc5-042e4aff3cd6 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2062a92a-f18f-4272-9aa7-48fbf2149406 req-b24032d4-afe0-43ff-9dc5-042e4aff3cd6 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-2062a92a-f18f-4272-9aa7-48fbf2149406 req-b24032d4-afe0-43ff-9dc5-042e4aff3cd6 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:37 user nova-compute[75305]: WARNING nova.compute.manager [req-2062a92a-f18f-4272-9aa7-48fbf2149406 req-b24032d4-afe0-43ff-9dc5-042e4aff3cd6 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state active and task_state rescuing.
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.673s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:20:37 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848 --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848,backing_fmt=raw /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.rescue {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.policy [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0b561dad6d74acfa63122951faf8f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38b3c6c530ef4c20b176189616d71c56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848,backing_fmt=raw /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.rescue" returned: 0 in 0.078s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "fbaf45db8b1c9b3927aeb14612dafa77722ae848" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'migration_context' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<64b4867a-3fba-49db-b4c7-2a92bfa4d0a5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Start _get_guest_xml network_info=[{"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "vif_mac": "fa:16:3e:b5:b1:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c5bbbc39-096e-457c-8459-913d303df308', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '12b60420-ba0a-4003-907a-ad7870eea66f', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raVmMnJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '64b4867a-3fba-49db-b4c7-2a92bfa4d0a5', 'attached_at': '', 'detached_at': '', 'volume_id': '0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'serial': '0bd001b4-ad73-4c2a-8e0a-d273df7dbe68'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'resources' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<64b4867a-3fba-49db-b4c7-2a92bfa4d0a5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'numa_topology' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<64b4867a-3fba-49db-b4c7-2a92bfa4d0a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:20:37 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:20:37 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:20:37 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Creating image(s)
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "/opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "/opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "/opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "a32e9b9f50328ac47f4989a65b3380fde82e68a8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "a32e9b9f50328ac47f4989a65b3380fde82e68a8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.objects.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<64b4867a-3fba-49db-b4c7-2a92bfa4d0a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raVmMnJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:20:37 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:20:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:20:37 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:20:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:20:37 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:20:37 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:20:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.part --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260" returned: 0 in 0.033s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccee59a2-bca0-4c9b-be2b-a3a87c979694]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = raVmMnJb\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 08:20:38 user nova-compute[75305]: node.name = iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68
Nov 14 08:20:38 user nova-compute[75305]: node.tpgt = -1
Nov 14 08:20:38 user nova-compute[75305]: node.startup = automatic
Nov 14 08:20:38 user nova-compute[75305]: node.leading_login = No
Nov 14 08:20:38 user nova-compute[75305]: iface.iscsi_ifacename = default
Nov 14 08:20:38 user nova-compute[75305]: iface.net_ifacename = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.ipaddress = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.prefix_len = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.hwaddress = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.transport_name = tcp
Nov 14 08:20:38 user nova-compute[75305]: iface.initiatorname = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.state = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.vlan_id = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.vlan_priority = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.vlan_state = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.iface_num = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.mtu = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.port = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.bootproto = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.subnet_mask = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.gateway = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_alt_client_id = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_dns = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_learn_iqn = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_vendor_id_state = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_vendor_id = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.dhcp_slp_da = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.fragmentation = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.gratuitous_arp = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.incoming_forwarding = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.tos_state = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.tos = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.ttl = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.delayed_ack = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.tcp_nagle = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.tcp_wsf_state = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.tcp_wsf = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.tcp_timer_scale = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.tcp_timestamp = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.redirect = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.def_task_mgmt_timeout = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.header_digest = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.data_digest = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.immediate_data = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.initial_r2t = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.data_seq_inorder = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.data_pdu_inorder = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.erl = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.max_receive_data_len = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.first_burst_len = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.max_outstanding_r2t = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.max_burst_len = 0
Nov 14 08:20:38 user nova-compute[75305]: iface.chap_auth = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.bidi_chap = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.strict_login_compliance = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.discovery_auth = <empty>
Nov 14 08:20:38 user nova-compute[75305]: iface.discovery_logout = <empty>
Nov 14 08:20:38 user nova-compute[75305]: node.discovery_address = <empty>
Nov 14 08:20:38 user nova-compute[75305]: node.discovery_port = 0
Nov 14 08:20:38 user nova-compute[75305]: node.discovery_type = static
Nov 14 08:20:38 user nova-compute[75305]: node.session.initial_cmdsn = 0
Nov 14 08:20:38 user nova-compute[75305]: node.session.initial_login_retry_max = 8
Nov 14 08:20:38 user nova-compute[75305]: node.session.xmit_thread_priority = -20
Nov 14 08:20:38 user nova-compute[75305]: node.session.cmds_max = 128
Nov 14 08:20:38 user nova-compute[75305]: node.session.queue_depth = 32
Nov 14 08:20:38 user nova-compute[75305]: node.session.nr_sessions = 1
Nov 14 08:20:38 user nova-compute[75305]: node.session.auth.authmethod = CHAP
Nov 14 08:20:38 user nova-compute[75305]: node.session.auth.username = raVmMnJb
Nov 14 08:20:38 user nova-compute[75305]: node.session.auth.password = ***
Nov 14 08:20:38 user nova-compute[75305]: node.session.auth.username_in = <empty>
Nov 14 08:20:38 user nova-compute[75305]: node.session.auth.password_in = <empty>
Nov 14 08:20:38 user nova-compute[75305]: node.session.auth.chap_algs = MD5
Nov 14 08:20:38 user nova-compute[75305]: node.session.timeo.replacement_timeout = 120
Nov 14 08:20:38 user nova-compute[75305]: node.session.err_timeo.abort_timeout = 15
Nov 14 08:20:38 user nova-compute[75305]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 08:20:38 user nova-compute[75305]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 08:20:38 user nova-compute[75305]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.FastAbort = Yes
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.InitialR2T = No
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.ImmediateData = Yes
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.MaxConnections = 1
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 08:20:38 user nova-compute[75305]: node.session.iscsi.ERL = 0
Nov 14 08:20:38 user nova-compute[75305]: node.session.scan = manual
Nov 14 08:20:38 user nova-compute[75305]: node.session.reopen_max = 0
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].address = 172.16.0.220
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].port = 3260
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].startup = manual
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].tcp.window_size = 524288
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].tcp.type_of_service = 0
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].timeo.logout_timeout = 15
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].timeo.login_timeout = 15
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].timeo.auth_timeout = 45
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].iscsi.DataDigest = None
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].iscsi.IFMarker = No
Nov 14 08:20:38 user nova-compute[75305]: node.conn[0].iscsi.OFMarker = No
Nov 14 08:20:38 user nova-compute[75305]: # END RECORD
Nov 14 08:20:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10ed022-ab7e-4ded-a2be-68dd4220b880]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Successfully created port: d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3167496-151b-40eb-b079-b407d7fa3d3b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raVmMnJb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raVmMnJb" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c77d3-2419-4a74-9145-0c5bc8abbf89]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'raVmMnJb'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa43648-2f55-42f2-b810-7338fc009a29]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f5a187-407b-4692-b173-dd4dbb70ada6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:20:38 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:20:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:20:38 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:20:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.008s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] HCTL ('34', '0', '0', 0) found on session 43 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.virt.images [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] 39b3f434-5a7d-4c20-a64b-aaba1d2f1507 was qcow2, converting to raw {{(pid=75305) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.privsep.utils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75305) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.part /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.converted {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3c911-dd74-456b-827c-fca49eeaa7aa]: (4, ('0 0 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Searching for a device in session 43 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raVmMnJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.067s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== connect_volume: return (1068ms) {'type': 'block', 'scsi_wwn': '23933646337653639', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933646337653639', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1507680698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1507680698',id=36,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:18:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-a5s8xoyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:18:59Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=64b4867a-3fba-49db-b4c7-2a92bfa4d0a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "vif_mac": "fa:16:3e:b5:b1:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "vif_mac": "fa:16:3e:b5:b1:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'pci_devices' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.objects.base [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Object Instance<64b4867a-3fba-49db-b4c7-2a92bfa4d0a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:20:38 user nova-compute[75305]:   <uuid>64b4867a-3fba-49db-b4c7-2a92bfa4d0a5</uuid>
Nov 14 08:20:38 user nova-compute[75305]:   <name>instance-00000024</name>
Nov 14 08:20:38 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:20:38 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:20:38 user nova-compute[75305]:   <metadata>
Nov 14 08:20:38 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:20:38 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:20:38 user nova-compute[75305]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1507680698</nova:name>
Nov 14 08:20:38 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:20:37</nova:creationTime>
Nov 14 08:20:38 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:20:38 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:20:38 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:20:38 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:20:38 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:20:38 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:20:38 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:20:38 user nova-compute[75305]:       <nova:owner>
Nov 14 08:20:38 user nova-compute[75305]:         <nova:user uuid="74b6bdb955524015ad1aec74ee466957">tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member</nova:user>
Nov 14 08:20:38 user nova-compute[75305]:         <nova:project uuid="f92869b8c2e246ca8f9d361c8ecabac0">tempest-ServerBootFromVolumeStableRescueTest-983718269</nova:project>
Nov 14 08:20:38 user nova-compute[75305]:       </nova:owner>
Nov 14 08:20:38 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:20:38 user nova-compute[75305]:       <nova:ports>
Nov 14 08:20:38 user nova-compute[75305]:         <nova:port uuid="22af325a-a511-4313-a09e-4d0804a62b0b">
Nov 14 08:20:38 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 08:20:38 user nova-compute[75305]:         </nova:port>
Nov 14 08:20:38 user nova-compute[75305]:       </nova:ports>
Nov 14 08:20:38 user nova-compute[75305]:     </nova:instance>
Nov 14 08:20:38 user nova-compute[75305]:   </metadata>
Nov 14 08:20:38 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:20:38 user nova-compute[75305]:     <system>
Nov 14 08:20:38 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:20:38 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:20:38 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:20:38 user nova-compute[75305]:       <entry name="serial">64b4867a-3fba-49db-b4c7-2a92bfa4d0a5</entry>
Nov 14 08:20:38 user nova-compute[75305]:       <entry name="uuid">64b4867a-3fba-49db-b4c7-2a92bfa4d0a5</entry>
Nov 14 08:20:38 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:20:38 user nova-compute[75305]:     </system>
Nov 14 08:20:38 user nova-compute[75305]:   </sysinfo>
Nov 14 08:20:38 user nova-compute[75305]:   <os>
Nov 14 08:20:38 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:20:38 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:20:38 user nova-compute[75305]:   </os>
Nov 14 08:20:38 user nova-compute[75305]:   <features>
Nov 14 08:20:38 user nova-compute[75305]:     <acpi/>
Nov 14 08:20:38 user nova-compute[75305]:     <apic/>
Nov 14 08:20:38 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:20:38 user nova-compute[75305]:   </features>
Nov 14 08:20:38 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:20:38 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:20:38 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:20:38 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:20:38 user nova-compute[75305]:   </clock>
Nov 14 08:20:38 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:20:38 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:20:38 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:20:38 user nova-compute[75305]:   </cpu>
Nov 14 08:20:38 user nova-compute[75305]:   <devices>
Nov 14 08:20:38 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:20:38 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:20:38 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:20:38 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:20:38 user nova-compute[75305]:       <serial>0bd001b4-ad73-4c2a-8e0a-d273df7dbe68</serial>
Nov 14 08:20:38 user nova-compute[75305]:     </disk>
Nov 14 08:20:38 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:20:38 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:20:38 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.rescue"/>
Nov 14 08:20:38 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:20:38 user nova-compute[75305]:       <boot order="1"/>
Nov 14 08:20:38 user nova-compute[75305]:     </disk>
Nov 14 08:20:38 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:20:38 user nova-compute[75305]:       <mac address="fa:16:3e:b5:b1:38"/>
Nov 14 08:20:38 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:20:38 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:20:38 user nova-compute[75305]:       <target dev="tap22af325a-a5"/>
Nov 14 08:20:38 user nova-compute[75305]:     </interface>
Nov 14 08:20:38 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:20:38 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/console.log" append="off"/>
Nov 14 08:20:38 user nova-compute[75305]:     </serial>
Nov 14 08:20:38 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:20:38 user nova-compute[75305]:     <video>
Nov 14 08:20:38 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:20:38 user nova-compute[75305]:     </video>
Nov 14 08:20:38 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:20:38 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:20:38 user nova-compute[75305]:     </rng>
Nov 14 08:20:38 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:20:38 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:20:38 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:20:38 user nova-compute[75305]:     </memballoon>
Nov 14 08:20:38 user nova-compute[75305]:   </devices>
Nov 14 08:20:38 user nova-compute[75305]: </domain>
Nov 14 08:20:38 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:20:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance destroyed successfully.
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] No VIF found with MAC fa:16:3e:b5:b1:38, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.part /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.converted" returned: 0 in 0.503s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.converted --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "a32e9b9f50328ac47f4989a65b3380fde82e68a8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.794s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8 --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "a32e9b9f50328ac47f4989a65b3380fde82e68a8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "a32e9b9f50328ac47f4989a65b3380fde82e68a8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8 --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8,backing_fmt=raw /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8,backing_fmt=raw /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk 1073741824" returned: 0 in 0.046s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "a32e9b9f50328ac47f4989a65b3380fde82e68a8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8 --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Ensure instance console log exists: /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Successfully updated port: d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquired lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-changed-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG nova.compute.manager [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Refreshing instance network info cache due to event network-changed-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] Acquiring lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:20:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updating instance_info_cache with network_info: [{"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Releasing lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Instance network_info: |[{"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] Acquired lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Refreshing network info cache for port d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Start _get_guest_xml network_info=[{"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='40d5a49e02b4ed69cd620d0516562cf8',container_format='bare',created_at=2023-11-14T08:20:29Z,direct_url=<?>,disk_format='qcow2',id=39b3f434-5a7d-4c20-a64b-aaba1d2f1507,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-505067651',owner='38b3c6c530ef4c20b176189616d71c56',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T08:20:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '39b3f434-5a7d-4c20-a64b-aaba1d2f1507'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:20:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:20:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='40d5a49e02b4ed69cd620d0516562cf8',container_format='bare',created_at=2023-11-14T08:20:29Z,direct_url=<?>,disk_format='qcow2',id=39b3f434-5a7d-4c20-a64b-aaba1d2f1507,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-505067651',owner='38b3c6c530ef4c20b176189616d71c56',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T08:20:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-787736376',display_name='tempest-TestStampPattern-server-787736376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-787736376',id=37,image_ref='39b3f434-5a7d-4c20-a64b-aaba1d2f1507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDECpqXZ39yJhKNBdtHyasJhkEpTXP1jf3ZW+cfIJ2zbLVCmgEy5+PFQBkFXCyo6idt7/qq9uAbj+UgLZkJ9h0TNVNbnRQfF91Cg5e9J2qAT5cWwGnjSjvl8hUs4n/TyWg==',key_name='tempest-TestStampPattern-1143433304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38b3c6c530ef4c20b176189616d71c56',ramdisk_id='',reservation_id='r-2qxnpvf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5b229490-ec43-495b-88f4-b829dd71c07b',image_min_disk='1',image_min_ram='0',image_owner_id='38b3c6c530ef4c20b176189616d71c56',image_owner_project_name='tempest-TestStampPattern-1608752450',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1608752450-project-member',image_user_id='b0b561dad6d74acfa63122951faf8f37',network_allocated='True',owner_project_name='tempest-TestStampPattern-1608752450',owner_user_name='tempest-TestStampPattern-1608752450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:20:37Z,user_data=None,user_id='b0b561dad6d74acfa63122951faf8f37',uuid=df425ccc-d6d2-4fdf-802b-41e35fe5d884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converting VIF {"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:ee:e4,bridge_name='br-int',has_traffic_filtering=True,id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86e55d4-bc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'pci_devices' on Instance uuid df425ccc-d6d2-4fdf-802b-41e35fe5d884 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:20:40 user nova-compute[75305]:   <uuid>df425ccc-d6d2-4fdf-802b-41e35fe5d884</uuid>
Nov 14 08:20:40 user nova-compute[75305]:   <name>instance-00000025</name>
Nov 14 08:20:40 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:20:40 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:20:40 user nova-compute[75305]:   <metadata>
Nov 14 08:20:40 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:20:40 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:20:40 user nova-compute[75305]:       <nova:name>tempest-TestStampPattern-server-787736376</nova:name>
Nov 14 08:20:40 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:20:40</nova:creationTime>
Nov 14 08:20:40 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:20:40 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:20:40 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:20:40 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:20:40 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:20:40 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:20:40 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:20:40 user nova-compute[75305]:       <nova:owner>
Nov 14 08:20:40 user nova-compute[75305]:         <nova:user uuid="b0b561dad6d74acfa63122951faf8f37">tempest-TestStampPattern-1608752450-project-member</nova:user>
Nov 14 08:20:40 user nova-compute[75305]:         <nova:project uuid="38b3c6c530ef4c20b176189616d71c56">tempest-TestStampPattern-1608752450</nova:project>
Nov 14 08:20:40 user nova-compute[75305]:       </nova:owner>
Nov 14 08:20:40 user nova-compute[75305]:       <nova:root type="image" uuid="39b3f434-5a7d-4c20-a64b-aaba1d2f1507"/>
Nov 14 08:20:40 user nova-compute[75305]:       <nova:ports>
Nov 14 08:20:40 user nova-compute[75305]:         <nova:port uuid="d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646">
Nov 14 08:20:40 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 08:20:40 user nova-compute[75305]:         </nova:port>
Nov 14 08:20:40 user nova-compute[75305]:       </nova:ports>
Nov 14 08:20:40 user nova-compute[75305]:     </nova:instance>
Nov 14 08:20:40 user nova-compute[75305]:   </metadata>
Nov 14 08:20:40 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:20:40 user nova-compute[75305]:     <system>
Nov 14 08:20:40 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:20:40 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:20:40 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:20:40 user nova-compute[75305]:       <entry name="serial">df425ccc-d6d2-4fdf-802b-41e35fe5d884</entry>
Nov 14 08:20:40 user nova-compute[75305]:       <entry name="uuid">df425ccc-d6d2-4fdf-802b-41e35fe5d884</entry>
Nov 14 08:20:40 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:20:40 user nova-compute[75305]:     </system>
Nov 14 08:20:40 user nova-compute[75305]:   </sysinfo>
Nov 14 08:20:40 user nova-compute[75305]:   <os>
Nov 14 08:20:40 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:20:40 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:20:40 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:20:40 user nova-compute[75305]:   </os>
Nov 14 08:20:40 user nova-compute[75305]:   <features>
Nov 14 08:20:40 user nova-compute[75305]:     <acpi/>
Nov 14 08:20:40 user nova-compute[75305]:     <apic/>
Nov 14 08:20:40 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:20:40 user nova-compute[75305]:   </features>
Nov 14 08:20:40 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:20:40 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:20:40 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:20:40 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:20:40 user nova-compute[75305]:   </clock>
Nov 14 08:20:40 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:20:40 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:20:40 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:20:40 user nova-compute[75305]:   </cpu>
Nov 14 08:20:40 user nova-compute[75305]:   <devices>
Nov 14 08:20:40 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:20:40 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:20:40 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk"/>
Nov 14 08:20:40 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:20:40 user nova-compute[75305]:     </disk>
Nov 14 08:20:40 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:20:40 user nova-compute[75305]:       <mac address="fa:16:3e:00:ee:e4"/>
Nov 14 08:20:40 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:20:40 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:20:40 user nova-compute[75305]:       <target dev="tapd86e55d4-bc"/>
Nov 14 08:20:40 user nova-compute[75305]:     </interface>
Nov 14 08:20:40 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:20:40 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/console.log" append="off"/>
Nov 14 08:20:40 user nova-compute[75305]:     </serial>
Nov 14 08:20:40 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:20:40 user nova-compute[75305]:     <video>
Nov 14 08:20:40 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:20:40 user nova-compute[75305]:     </video>
Nov 14 08:20:40 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:20:40 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:20:40 user nova-compute[75305]:     </rng>
Nov 14 08:20:40 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:20:40 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:20:40 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:20:40 user nova-compute[75305]:     </memballoon>
Nov 14 08:20:40 user nova-compute[75305]:   </devices>
Nov 14 08:20:40 user nova-compute[75305]: </domain>
Nov 14 08:20:40 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-787736376',display_name='tempest-TestStampPattern-server-787736376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-787736376',id=37,image_ref='39b3f434-5a7d-4c20-a64b-aaba1d2f1507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDECpqXZ39yJhKNBdtHyasJhkEpTXP1jf3ZW+cfIJ2zbLVCmgEy5+PFQBkFXCyo6idt7/qq9uAbj+UgLZkJ9h0TNVNbnRQfF91Cg5e9J2qAT5cWwGnjSjvl8hUs4n/TyWg==',key_name='tempest-TestStampPattern-1143433304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='38b3c6c530ef4c20b176189616d71c56',ramdisk_id='',reservation_id='r-2qxnpvf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5b229490-ec43-495b-88f4-b829dd71c07b',image_min_disk='1',image_min_ram='0',image_owner_id='38b3c6c530ef4c20b176189616d71c56',image_owner_project_name='tempest-TestStampPattern-1608752450',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1608752450-project-member',image_user_id='b0b561dad6d74acfa63122951faf8f37',network_allocated='True',owner_project_name='tempest-TestStampPattern-1608752450',owner_user_name='tempest-TestStampPattern-1608752450-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:20:37Z,user_data=None,user_id='b0b561dad6d74acfa63122951faf8f37',uuid=df425ccc-d6d2-4fdf-802b-41e35fe5d884,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converting VIF {"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:ee:e4,bridge_name='br-int',has_traffic_filtering=True,id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86e55d4-bc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG os_vif [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:ee:e4,bridge_name='br-int',has_traffic_filtering=True,id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86e55d4-bc') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c551dc28-ceaf-5574-b6ea-9ea876450546', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd86e55d4-bc, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd86e55d4-bc, col_values=(('qos', UUID('5cd79edb-b932-4301-a640-635c0007052c')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd86e55d4-bc, col_values=(('external_ids', {'iface-id': 'd86e55d4-bc8d-4f8d-9c72-2b8aecc6b646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:ee:e4', 'vm-uuid': 'df425ccc-d6d2-4fdf-802b-41e35fe5d884'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:40 user nova-compute[75305]: INFO os_vif [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:ee:e4,bridge_name='br-int',has_traffic_filtering=True,id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86e55d4-bc')
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-754a65a9-59e9-44e2-8802-ab5e010bca6d req-58b7c13a-4078-481a-9129-3d43df0c5ece service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-754a65a9-59e9-44e2-8802-ab5e010bca6d req-58b7c13a-4078-481a-9129-3d43df0c5ece service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-754a65a9-59e9-44e2-8802-ab5e010bca6d req-58b7c13a-4078-481a-9129-3d43df0c5ece service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-754a65a9-59e9-44e2-8802-ab5e010bca6d req-58b7c13a-4078-481a-9129-3d43df0c5ece service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-754a65a9-59e9-44e2-8802-ab5e010bca6d req-58b7c13a-4078-481a-9129-3d43df0c5ece service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:40 user nova-compute[75305]: WARNING nova.compute.manager [req-754a65a9-59e9-44e2-8802-ab5e010bca6d req-58b7c13a-4078-481a-9129-3d43df0c5ece service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state active and task_state rescuing.
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No VIF found with MAC fa:16:3e:00:ee:e4, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updated VIF entry in instance network info cache for port d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG nova.network.neutron [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updating instance_info_cache with network_info: [{"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:20:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-235f6408-e69e-46c8-8e25-d43593cf420a req-e3a1e877-b6dc-4870-b21c-1c58cd584609 service nova] Releasing lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:20:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c070340-a1ac-44c3-821b-057f0782fce7 req-4094f55f-a824-4da0-af06-172d4754802a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c070340-a1ac-44c3-821b-057f0782fce7 req-4094f55f-a824-4da0-af06-172d4754802a service nova] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c070340-a1ac-44c3-821b-057f0782fce7 req-4094f55f-a824-4da0-af06-172d4754802a service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2c070340-a1ac-44c3-821b-057f0782fce7 req-4094f55f-a824-4da0-af06-172d4754802a service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c070340-a1ac-44c3-821b-057f0782fce7 req-4094f55f-a824-4da0-af06-172d4754802a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] No waiting events found dispatching network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:41 user nova-compute[75305]: WARNING nova.compute.manager [req-2c070340-a1ac-44c3-821b-057f0782fce7 req-4094f55f-a824-4da0-af06-172d4754802a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received unexpected event network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 for instance with vm_state building and task_state spawning.
Nov 14 08:20:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-6b18fdae-5696-4a97-bf7d-706381d65912 req-73fd120b-e3a0-42c6-98aa-f24406ab206f service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6b18fdae-5696-4a97-bf7d-706381d65912 req-73fd120b-e3a0-42c6-98aa-f24406ab206f service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6b18fdae-5696-4a97-bf7d-706381d65912 req-73fd120b-e3a0-42c6-98aa-f24406ab206f service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6b18fdae-5696-4a97-bf7d-706381d65912 req-73fd120b-e3a0-42c6-98aa-f24406ab206f service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-6b18fdae-5696-4a97-bf7d-706381d65912 req-73fd120b-e3a0-42c6-98aa-f24406ab206f service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:42 user nova-compute[75305]: WARNING nova.compute.manager [req-6b18fdae-5696-4a97-bf7d-706381d65912 req-73fd120b-e3a0-42c6-98aa-f24406ab206f service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state active and task_state rescuing.
Nov 14 08:20:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-1bb78651-a5de-43ee-bd34-0911285ef482 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:20:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-5867a1fa-4194-4ce3-bb1a-2cd9811b273b req-1cfd6587-fc8e-46e9-828a-8a70f2a8f4f8 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:20:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5867a1fa-4194-4ce3-bb1a-2cd9811b273b req-1cfd6587-fc8e-46e9-828a-8a70f2a8f4f8 service nova] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:20:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5867a1fa-4194-4ce3-bb1a-2cd9811b273b req-1cfd6587-fc8e-46e9-828a-8a70f2a8f4f8 service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:20:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5867a1fa-4194-4ce3-bb1a-2cd9811b273b req-1cfd6587-fc8e-46e9-828a-8a70f2a8f4f8 service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-5867a1fa-4194-4ce3-bb1a-2cd9811b273b req-1cfd6587-fc8e-46e9-828a-8a70f2a8f4f8 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] No waiting events found dispatching network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:20:43 user nova-compute[75305]: WARNING nova.compute.manager [req-5867a1fa-4194-4ce3-bb1a-2cd9811b273b req-1cfd6587-fc8e-46e9-828a-8a70f2a8f4f8 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received unexpected event network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 for instance with vm_state building and task_state spawning.
Nov 14 08:20:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:20:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:20:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Instance spawned successfully.
Nov 14 08:20:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:20:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:20:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:20:44 user nova-compute[75305]: INFO nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 14 08:20:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:20:44 user nova-compute[75305]: INFO nova.compute.manager [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Took 7.93 seconds to build instance.
Nov 14 08:20:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a500534d-07b2-4b59-9430-11a63edb553f tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.032s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:20:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:20:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:20:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "ed790e9a-940e-4541-8d5a-832398783c0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "ed790e9a-940e-4541-8d5a-832398783c0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:21:02 user nova-compute[75305]: INFO nova.compute.claims [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Claim successful on node user
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:21:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.policy [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5997915995004b44ba724d220b5c46a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2478d3b11c2b41e580ffcc1d3a1215de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:21:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Creating image(s)
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "/opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "/opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Successfully created port: b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk 1073741824" returned: 0 in 0.062s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Cannot resize image /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Ensure instance console log exists: /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Successfully updated port: b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "refresh_cache-ed790e9a-940e-4541-8d5a-832398783c0d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquired lock "refresh_cache-ed790e9a-940e-4541-8d5a-832398783c0d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received event network-changed-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Refreshing instance network info cache due to event network-changed-b8f6a787-9cc9-41a8-b827-d50b85439027. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] Acquiring lock "refresh_cache-ed790e9a-940e-4541-8d5a-832398783c0d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Updating instance_info_cache with network_info: [{"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Releasing lock "refresh_cache-ed790e9a-940e-4541-8d5a-832398783c0d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Instance network_info: |[{"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] Acquired lock "refresh_cache-ed790e9a-940e-4541-8d5a-832398783c0d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Refreshing network info cache for port b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Start _get_guest_xml network_info=[{"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:21:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:21:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-830357312',display_name='tempest-VolumesActionsTest-instance-830357312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-830357312',id=38,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2478d3b11c2b41e580ffcc1d3a1215de',ramdisk_id='',reservation_id='r-urrmgbly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1814532565',owner_user_name='tempest-VolumesActionsTest-1814532565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:21:03Z,user_data=None,user_id='5997915995004b44ba724d220b5c46a0',uuid=ed790e9a-940e-4541-8d5a-832398783c0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converting VIF {"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f1:af,bridge_name='br-int',has_traffic_filtering=True,id=b8f6a787-9cc9-41a8-b827-d50b85439027,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f6a787-9c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.objects.instance [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lazy-loading 'pci_devices' on Instance uuid ed790e9a-940e-4541-8d5a-832398783c0d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:21:04 user nova-compute[75305]:   <uuid>ed790e9a-940e-4541-8d5a-832398783c0d</uuid>
Nov 14 08:21:04 user nova-compute[75305]:   <name>instance-00000026</name>
Nov 14 08:21:04 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:21:04 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:21:04 user nova-compute[75305]:   <metadata>
Nov 14 08:21:04 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:21:04 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:21:04 user nova-compute[75305]:       <nova:name>tempest-VolumesActionsTest-instance-830357312</nova:name>
Nov 14 08:21:04 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:21:04</nova:creationTime>
Nov 14 08:21:04 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:21:04 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:21:04 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:21:04 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:21:04 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:21:04 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:21:04 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:21:04 user nova-compute[75305]:       <nova:owner>
Nov 14 08:21:04 user nova-compute[75305]:         <nova:user uuid="5997915995004b44ba724d220b5c46a0">tempest-VolumesActionsTest-1814532565-project-member</nova:user>
Nov 14 08:21:04 user nova-compute[75305]:         <nova:project uuid="2478d3b11c2b41e580ffcc1d3a1215de">tempest-VolumesActionsTest-1814532565</nova:project>
Nov 14 08:21:04 user nova-compute[75305]:       </nova:owner>
Nov 14 08:21:04 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:21:04 user nova-compute[75305]:       <nova:ports>
Nov 14 08:21:04 user nova-compute[75305]:         <nova:port uuid="b8f6a787-9cc9-41a8-b827-d50b85439027">
Nov 14 08:21:04 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:21:04 user nova-compute[75305]:         </nova:port>
Nov 14 08:21:04 user nova-compute[75305]:       </nova:ports>
Nov 14 08:21:04 user nova-compute[75305]:     </nova:instance>
Nov 14 08:21:04 user nova-compute[75305]:   </metadata>
Nov 14 08:21:04 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:21:04 user nova-compute[75305]:     <system>
Nov 14 08:21:04 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:21:04 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:21:04 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:21:04 user nova-compute[75305]:       <entry name="serial">ed790e9a-940e-4541-8d5a-832398783c0d</entry>
Nov 14 08:21:04 user nova-compute[75305]:       <entry name="uuid">ed790e9a-940e-4541-8d5a-832398783c0d</entry>
Nov 14 08:21:04 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:21:04 user nova-compute[75305]:     </system>
Nov 14 08:21:04 user nova-compute[75305]:   </sysinfo>
Nov 14 08:21:04 user nova-compute[75305]:   <os>
Nov 14 08:21:04 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:21:04 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:21:04 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:21:04 user nova-compute[75305]:   </os>
Nov 14 08:21:04 user nova-compute[75305]:   <features>
Nov 14 08:21:04 user nova-compute[75305]:     <acpi/>
Nov 14 08:21:04 user nova-compute[75305]:     <apic/>
Nov 14 08:21:04 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:21:04 user nova-compute[75305]:   </features>
Nov 14 08:21:04 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:21:04 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:21:04 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:21:04 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:21:04 user nova-compute[75305]:   </clock>
Nov 14 08:21:04 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:21:04 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:21:04 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:21:04 user nova-compute[75305]:   </cpu>
Nov 14 08:21:04 user nova-compute[75305]:   <devices>
Nov 14 08:21:04 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:21:04 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:21:04 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk"/>
Nov 14 08:21:04 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:21:04 user nova-compute[75305]:     </disk>
Nov 14 08:21:04 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:21:04 user nova-compute[75305]:       <mac address="fa:16:3e:5e:f1:af"/>
Nov 14 08:21:04 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:21:04 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:21:04 user nova-compute[75305]:       <target dev="tapb8f6a787-9c"/>
Nov 14 08:21:04 user nova-compute[75305]:     </interface>
Nov 14 08:21:04 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:21:04 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/console.log" append="off"/>
Nov 14 08:21:04 user nova-compute[75305]:     </serial>
Nov 14 08:21:04 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:21:04 user nova-compute[75305]:     <video>
Nov 14 08:21:04 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:21:04 user nova-compute[75305]:     </video>
Nov 14 08:21:04 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:21:04 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:21:04 user nova-compute[75305]:     </rng>
Nov 14 08:21:04 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:21:04 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:21:04 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:21:04 user nova-compute[75305]:     </memballoon>
Nov 14 08:21:04 user nova-compute[75305]:   </devices>
Nov 14 08:21:04 user nova-compute[75305]: </domain>
Nov 14 08:21:04 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-830357312',display_name='tempest-VolumesActionsTest-instance-830357312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-830357312',id=38,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2478d3b11c2b41e580ffcc1d3a1215de',ramdisk_id='',reservation_id='r-urrmgbly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1814532565',owner_user_name='tempest-VolumesActionsTest-1814532565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:21:03Z,user_data=None,user_id='5997915995004b44ba724d220b5c46a0',uuid=ed790e9a-940e-4541-8d5a-832398783c0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converting VIF {"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f1:af,bridge_name='br-int',has_traffic_filtering=True,id=b8f6a787-9cc9-41a8-b827-d50b85439027,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f6a787-9c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG os_vif [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f1:af,bridge_name='br-int',has_traffic_filtering=True,id=b8f6a787-9cc9-41a8-b827-d50b85439027,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f6a787-9c') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f830b8a-3652-5a75-936a-3279db5af42a', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8f6a787-9c, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8f6a787-9c, col_values=(('qos', UUID('23b8d584-0f7b-41f5-921f-9274bf15deb2')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8f6a787-9c, col_values=(('external_ids', {'iface-id': 'b8f6a787-9cc9-41a8-b827-d50b85439027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:f1:af', 'vm-uuid': 'ed790e9a-940e-4541-8d5a-832398783c0d'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:04 user nova-compute[75305]: INFO os_vif [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f1:af,bridge_name='br-int',has_traffic_filtering=True,id=b8f6a787-9cc9-41a8-b827-d50b85439027,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f6a787-9c')
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:21:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] No VIF found with MAC fa:16:3e:5e:f1:af, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:21:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Updated VIF entry in instance network info cache for port b8f6a787-9cc9-41a8-b827-d50b85439027. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:21:05 user nova-compute[75305]: DEBUG nova.network.neutron [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Updating instance_info_cache with network_info: [{"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:21:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-399dddc9-2f13-414e-b343-46aeb8b0c3c5 req-1c0aed42-d9c3-41ee-b37d-81bc885cd8fb service nova] Releasing lock "refresh_cache-ed790e9a-940e-4541-8d5a-832398783c0d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:21:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-80fbee2b-0a1a-4ba4-ad39-d807d3df435e req-60d415f6-ca13-4fb3-929f-cb8515c2b270 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received event network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-80fbee2b-0a1a-4ba4-ad39-d807d3df435e req-60d415f6-ca13-4fb3-929f-cb8515c2b270 service nova] Acquiring lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-80fbee2b-0a1a-4ba4-ad39-d807d3df435e req-60d415f6-ca13-4fb3-929f-cb8515c2b270 service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-80fbee2b-0a1a-4ba4-ad39-d807d3df435e req-60d415f6-ca13-4fb3-929f-cb8515c2b270 service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-80fbee2b-0a1a-4ba4-ad39-d807d3df435e req-60d415f6-ca13-4fb3-929f-cb8515c2b270 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] No waiting events found dispatching network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:21:06 user nova-compute[75305]: WARNING nova.compute.manager [req-80fbee2b-0a1a-4ba4-ad39-d807d3df435e req-60d415f6-ca13-4fb3-929f-cb8515c2b270 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received unexpected event network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 for instance with vm_state building and task_state spawning.
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "ceafdd37-52d0-4350-80cf-01c381b6fffd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:21:07 user nova-compute[75305]: INFO nova.compute.claims [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Claim successful on node user
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.network.neutron [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:21:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:21:07 user nova-compute[75305]: DEBUG nova.policy [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ab16b506cdf4f4f889b9cbe639967b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28cfda668593413b9db2ce366dd23017', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.compute.manager [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Terminating instance
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Creating image(s)
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "/opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "/opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "/opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.207s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d4e90a9-9f14-468b-b633-d785e2148be8 req-811ea241-395d-4051-b517-a4bc50f37c42 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received event network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d4e90a9-9f14-468b-b633-d785e2148be8 req-811ea241-395d-4051-b517-a4bc50f37c42 service nova] Acquiring lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d4e90a9-9f14-468b-b633-d785e2148be8 req-811ea241-395d-4051-b517-a4bc50f37c42 service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d4e90a9-9f14-468b-b633-d785e2148be8 req-811ea241-395d-4051-b517-a4bc50f37c42 service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d4e90a9-9f14-468b-b633-d785e2148be8 req-811ea241-395d-4051-b517-a4bc50f37c42 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] No waiting events found dispatching network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:21:08 user nova-compute[75305]: WARNING nova.compute.manager [req-0d4e90a9-9f14-468b-b633-d785e2148be8 req-811ea241-395d-4051-b517-a4bc50f37c42 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received unexpected event network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 for instance with vm_state building and task_state spawning.
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Instance spawned successfully.
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.190s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-aa4c5bf2-7e2f-460f-91ab-a632e2ed735d req-db4350b4-6b09-484e-b87b-ff12a24e0867 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-vif-unplugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aa4c5bf2-7e2f-460f-91ab-a632e2ed735d req-db4350b4-6b09-484e-b87b-ff12a24e0867 service nova] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aa4c5bf2-7e2f-460f-91ab-a632e2ed735d req-db4350b4-6b09-484e-b87b-ff12a24e0867 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aa4c5bf2-7e2f-460f-91ab-a632e2ed735d req-db4350b4-6b09-484e-b87b-ff12a24e0867 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-aa4c5bf2-7e2f-460f-91ab-a632e2ed735d req-db4350b4-6b09-484e-b87b-ff12a24e0867 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] No waiting events found dispatching network-vif-unplugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-aa4c5bf2-7e2f-460f-91ab-a632e2ed735d req-db4350b4-6b09-484e-b87b-ff12a24e0867 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-vif-unplugged-a89876c5-db54-4173-ae04-a88c966b86b5 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.network.neutron [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Successfully created port: d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Took 5.77 seconds to spawn the instance on the hypervisor.
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk 1073741824" returned: 0 in 0.081s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.compute.manager [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Took 6.49 seconds to build instance.
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-40694759-f577-4a12-96c3-9ebeec52361e tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "ed790e9a-940e-4541-8d5a-832398783c0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.579s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Instance destroyed successfully.
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lazy-loading 'resources' on Instance uuid 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1313446680',display_name='tempest-ServerActionsTestOtherA-server-1313446680',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1313446680',id=1,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3SnITs6Jc2rwDdFWg+d1tfv97AQqMrZIccInSGUvZ860Cb94XbvgCsIBW9IDItD7NHY356IiQ42G/UX9RDUuVLs3Xw0nqqW0WUSl+QBbDOElMMxys/y5yELnoE+rdc3g==',key_name='tempest-keypair-869974480',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:02:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34a93139587f4dc0b2bd586961056c6c',ramdisk_id='',reservation_id='r-zk2o7a6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-723782501',owner_user_name='tempest-ServerActionsTestOtherA-723782501-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='574c9a82a4994bdcb60c5d96b199d69a',uuid=9736f35c-ddc9-4666-b5c4-cb1006c3fcf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converting VIF {"id": "a89876c5-db54-4173-ae04-a88c966b86b5", "address": "fa:16:3e:d5:66:d4", "network": {"id": "6310a0b2-3f56-4d30-b988-0df3278951be", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-239072767-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a93139587f4dc0b2bd586961056c6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa89876c5-db", "ovs_interfaceid": "a89876c5-db54-4173-ae04-a88c966b86b5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:66:d4,bridge_name='br-int',has_traffic_filtering=True,id=a89876c5-db54-4173-ae04-a88c966b86b5,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89876c5-db') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG os_vif [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:66:d4,bridge_name='br-int',has_traffic_filtering=True,id=a89876c5-db54-4173-ae04-a88c966b86b5,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89876c5-db') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa89876c5-db, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c325ae1-65bf-4765-9960-53a40771cafe) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:08 user nova-compute[75305]: INFO os_vif [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:66:d4,bridge_name='br-int',has_traffic_filtering=True,id=a89876c5-db54-4173-ae04-a88c966b86b5,network=Network(6310a0b2-3f56-4d30-b988-0df3278951be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa89876c5-db')
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Deleting instance files /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9_del
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Deletion of /opt/stack/data/nova/instances/9736f35c-ddc9-4666-b5c4-cb1006c3fcf9_del complete
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Cannot resize image /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Ensure instance console log exists: /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:08 user nova-compute[75305]: INFO nova.compute.manager [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 14 08:21:08 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:21:08 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Successfully updated port: d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "refresh_cache-ceafdd37-52d0-4350-80cf-01c381b6fffd" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquired lock "refresh_cache-ceafdd37-52d0-4350-80cf-01c381b6fffd" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:21:09 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Took 0.60 seconds to deallocate network for instance.
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0664a79-0c5d-4c92-ae23-6fc474b7379d req-47ae631e-937a-4f6d-91a3-5c9a92c2dbd5 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-vif-deleted-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:09 user nova-compute[75305]: INFO nova.compute.manager [req-e0664a79-0c5d-4c92-ae23-6fc474b7379d req-47ae631e-937a-4f6d-91a3-5c9a92c2dbd5 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Neutron deleted interface a89876c5-db54-4173-ae04-a88c966b86b5; detaching it from the instance and deleting it from the info cache
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.neutron [req-e0664a79-0c5d-4c92-ae23-6fc474b7379d req-47ae631e-937a-4f6d-91a3-5c9a92c2dbd5 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-e0664a79-0c5d-4c92-ae23-6fc474b7379d req-47ae631e-937a-4f6d-91a3-5c9a92c2dbd5 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Detach interface failed, port_id=a89876c5-db54-4173-ae04-a88c966b86b5, reason: Instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9 could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Updating instance_info_cache with network_info: [{"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Releasing lock "refresh_cache-ceafdd37-52d0-4350-80cf-01c381b6fffd" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Instance network_info: |[{"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Start _get_guest_xml network_info=[{"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:21:09 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:21:09 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1241589857',display_name='tempest-VolumesActionsTest-instance-1241589857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1241589857',id=39,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28cfda668593413b9db2ce366dd23017',ramdisk_id='',reservation_id='r-3nn9gdjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-520211291',owner_user_name='tempest-VolumesActionsTest-520211291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:21:08Z,user_data=None,user_id='6ab16b506cdf4f4f889b9cbe639967b1',uuid=ceafdd37-52d0-4350-80cf-01c381b6fffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Converting VIF {"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1d23cbf-ba15-4ce9-ab1b-bd631de7f441,network=Network(e137d83e-5a78-4742-a716-179e614c7ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d23cbf-ba') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.objects.instance [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lazy-loading 'pci_devices' on Instance uuid ceafdd37-52d0-4350-80cf-01c381b6fffd {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:21:09 user nova-compute[75305]:   <uuid>ceafdd37-52d0-4350-80cf-01c381b6fffd</uuid>
Nov 14 08:21:09 user nova-compute[75305]:   <name>instance-00000027</name>
Nov 14 08:21:09 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:21:09 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:21:09 user nova-compute[75305]:   <metadata>
Nov 14 08:21:09 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:21:09 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:21:09 user nova-compute[75305]:       <nova:name>tempest-VolumesActionsTest-instance-1241589857</nova:name>
Nov 14 08:21:09 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:21:09</nova:creationTime>
Nov 14 08:21:09 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:21:09 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:21:09 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:21:09 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:21:09 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:21:09 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:21:09 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:21:09 user nova-compute[75305]:       <nova:owner>
Nov 14 08:21:09 user nova-compute[75305]:         <nova:user uuid="6ab16b506cdf4f4f889b9cbe639967b1">tempest-VolumesActionsTest-520211291-project-member</nova:user>
Nov 14 08:21:09 user nova-compute[75305]:         <nova:project uuid="28cfda668593413b9db2ce366dd23017">tempest-VolumesActionsTest-520211291</nova:project>
Nov 14 08:21:09 user nova-compute[75305]:       </nova:owner>
Nov 14 08:21:09 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:21:09 user nova-compute[75305]:       <nova:ports>
Nov 14 08:21:09 user nova-compute[75305]:         <nova:port uuid="d1d23cbf-ba15-4ce9-ab1b-bd631de7f441">
Nov 14 08:21:09 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:21:09 user nova-compute[75305]:         </nova:port>
Nov 14 08:21:09 user nova-compute[75305]:       </nova:ports>
Nov 14 08:21:09 user nova-compute[75305]:     </nova:instance>
Nov 14 08:21:09 user nova-compute[75305]:   </metadata>
Nov 14 08:21:09 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:21:09 user nova-compute[75305]:     <system>
Nov 14 08:21:09 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:21:09 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:21:09 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:21:09 user nova-compute[75305]:       <entry name="serial">ceafdd37-52d0-4350-80cf-01c381b6fffd</entry>
Nov 14 08:21:09 user nova-compute[75305]:       <entry name="uuid">ceafdd37-52d0-4350-80cf-01c381b6fffd</entry>
Nov 14 08:21:09 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:21:09 user nova-compute[75305]:     </system>
Nov 14 08:21:09 user nova-compute[75305]:   </sysinfo>
Nov 14 08:21:09 user nova-compute[75305]:   <os>
Nov 14 08:21:09 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:21:09 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:21:09 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:21:09 user nova-compute[75305]:   </os>
Nov 14 08:21:09 user nova-compute[75305]:   <features>
Nov 14 08:21:09 user nova-compute[75305]:     <acpi/>
Nov 14 08:21:09 user nova-compute[75305]:     <apic/>
Nov 14 08:21:09 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:21:09 user nova-compute[75305]:   </features>
Nov 14 08:21:09 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:21:09 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:21:09 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:21:09 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:21:09 user nova-compute[75305]:   </clock>
Nov 14 08:21:09 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:21:09 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:21:09 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:21:09 user nova-compute[75305]:   </cpu>
Nov 14 08:21:09 user nova-compute[75305]:   <devices>
Nov 14 08:21:09 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:21:09 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:21:09 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk"/>
Nov 14 08:21:09 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:21:09 user nova-compute[75305]:     </disk>
Nov 14 08:21:09 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:21:09 user nova-compute[75305]:       <mac address="fa:16:3e:a8:c4:ac"/>
Nov 14 08:21:09 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:21:09 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:21:09 user nova-compute[75305]:       <target dev="tapd1d23cbf-ba"/>
Nov 14 08:21:09 user nova-compute[75305]:     </interface>
Nov 14 08:21:09 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:21:09 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/console.log" append="off"/>
Nov 14 08:21:09 user nova-compute[75305]:     </serial>
Nov 14 08:21:09 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:21:09 user nova-compute[75305]:     <video>
Nov 14 08:21:09 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:21:09 user nova-compute[75305]:     </video>
Nov 14 08:21:09 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:21:09 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:21:09 user nova-compute[75305]:     </rng>
Nov 14 08:21:09 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:21:09 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:21:09 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:21:09 user nova-compute[75305]:     </memballoon>
Nov 14 08:21:09 user nova-compute[75305]:   </devices>
Nov 14 08:21:09 user nova-compute[75305]: </domain>
Nov 14 08:21:09 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1241589857',display_name='tempest-VolumesActionsTest-instance-1241589857',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1241589857',id=39,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28cfda668593413b9db2ce366dd23017',ramdisk_id='',reservation_id='r-3nn9gdjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-520211291',owner_user_name='tempest-VolumesActionsTest-520211291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:21:08Z,user_data=None,user_id='6ab16b506cdf4f4f889b9cbe639967b1',uuid=ceafdd37-52d0-4350-80cf-01c381b6fffd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Converting VIF {"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1d23cbf-ba15-4ce9-ab1b-bd631de7f441,network=Network(e137d83e-5a78-4742-a716-179e614c7ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d23cbf-ba') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG os_vif [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1d23cbf-ba15-4ce9-ab1b-bd631de7f441,network=Network(e137d83e-5a78-4742-a716-179e614c7ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d23cbf-ba') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '401d1730-af1a-5cf2-8f62-40163c325c86', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1d23cbf-ba, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1d23cbf-ba, col_values=(('qos', UUID('63720b10-064a-42ea-9da4-4210fa0f116f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1d23cbf-ba, col_values=(('external_ids', {'iface-id': 'd1d23cbf-ba15-4ce9-ab1b-bd631de7f441', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:c4:ac', 'vm-uuid': 'ceafdd37-52d0-4350-80cf-01c381b6fffd'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:09 user nova-compute[75305]: INFO os_vif [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1d23cbf-ba15-4ce9-ab1b-bd631de7f441,network=Network(e137d83e-5a78-4742-a716-179e614c7ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d23cbf-ba')
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:21:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] No VIF found with MAC fa:16:3e:a8:c4:ac, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:10 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Deleted allocations for instance 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f43b2d48-08f3-4041-8770-40d94b34e828 tempest-ServerActionsTestOtherA-723782501 tempest-ServerActionsTestOtherA-723782501-project-member] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.181s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received event network-changed-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Refreshing instance network info cache due to event network-changed-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] Acquiring lock "refresh_cache-ceafdd37-52d0-4350-80cf-01c381b6fffd" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] Acquired lock "refresh_cache-ceafdd37-52d0-4350-80cf-01c381b6fffd" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Refreshing network info cache for port d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-b0fa29f4-ee4c-4aba-87ed-26dd98d8b367 req-c7c43ab0-037d-44b1-abba-cc03d11e1342 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received event network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b0fa29f4-ee4c-4aba-87ed-26dd98d8b367 req-c7c43ab0-037d-44b1-abba-cc03d11e1342 service nova] Acquiring lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b0fa29f4-ee4c-4aba-87ed-26dd98d8b367 req-c7c43ab0-037d-44b1-abba-cc03d11e1342 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b0fa29f4-ee4c-4aba-87ed-26dd98d8b367 req-c7c43ab0-037d-44b1-abba-cc03d11e1342 service nova] Lock "9736f35c-ddc9-4666-b5c4-cb1006c3fcf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.compute.manager [req-b0fa29f4-ee4c-4aba-87ed-26dd98d8b367 req-c7c43ab0-037d-44b1-abba-cc03d11e1342 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] No waiting events found dispatching network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:21:10 user nova-compute[75305]: WARNING nova.compute.manager [req-b0fa29f4-ee4c-4aba-87ed-26dd98d8b367 req-c7c43ab0-037d-44b1-abba-cc03d11e1342 service nova] [instance: 9736f35c-ddc9-4666-b5c4-cb1006c3fcf9] Received unexpected event network-vif-plugged-a89876c5-db54-4173-ae04-a88c966b86b5 for instance with vm_state deleted and task_state None.
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Updated VIF entry in instance network info cache for port d1d23cbf-ba15-4ce9-ab1b-bd631de7f441. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Updating instance_info_cache with network_info: [{"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:21:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-81af5485-b9d1-48e2-a540-8800a330ca16 req-3a313dd8-2eee-4e59-8af6-50c10f9b3d8f service nova] Releasing lock "refresh_cache-ceafdd37-52d0-4350-80cf-01c381b6fffd" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:21:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received event network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] Acquiring lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] No waiting events found dispatching network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:21:12 user nova-compute[75305]: WARNING nova.compute.manager [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received unexpected event network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 for instance with vm_state building and task_state spawning.
Nov 14 08:21:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received event network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] Acquiring lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:12 user nova-compute[75305]: DEBUG nova.compute.manager [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] No waiting events found dispatching network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:21:12 user nova-compute[75305]: WARNING nova.compute.manager [req-17f247dd-ebf3-4c6e-bef2-6cc00a3813a0 req-8a52184b-8fda-4816-87d8-7c5f72613900 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received unexpected event network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 for instance with vm_state building and task_state spawning.
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:21:13 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Instance spawned successfully.
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:21:13 user nova-compute[75305]: INFO nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Took 5.56 seconds to spawn the instance on the hypervisor.
Nov 14 08:21:13 user nova-compute[75305]: DEBUG nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:21:13 user nova-compute[75305]: INFO nova.compute.manager [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Took 6.40 seconds to build instance.
Nov 14 08:21:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-57897248-7cea-4203-9306-e1f25dd707c6 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.502s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:21:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:21:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:21:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:21:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=24.720684051513672GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5b229490-ec43-495b-88f4-b829dd71c07b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ed790e9a-940e-4541-8d5a-832398783c0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ceafdd37-52d0-4350-80cf-01c381b6fffd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:21:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:21:32 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:32 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:21:32 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:21:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:21:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:21:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:21:32 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid d16d469c-6caf-4ba0-869e-2eb0c4908d24 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updating instance_info_cache with network_info: [{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:21:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:21:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:21:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:21:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:21:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:21:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:22:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:22:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:22:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:22:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:22:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:22:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:22:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:24 user nova-compute[75305]: INFO nova.compute.manager [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Unrescuing
Nov 14 08:22:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquired lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Updating instance_info_cache with network_info: [{"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Releasing lock "refresh_cache-64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:22:24 user nova-compute[75305]: DEBUG nova.objects.instance [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'flavor' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-749fffc3-bc4e-436e-8aef-e688c4d07f39 req-63a49f70-b49b-4538-861c-00b69e45d6e2 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-749fffc3-bc4e-436e-8aef-e688c4d07f39 req-63a49f70-b49b-4538-861c-00b69e45d6e2 service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-749fffc3-bc4e-436e-8aef-e688c4d07f39 req-63a49f70-b49b-4538-861c-00b69e45d6e2 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-749fffc3-bc4e-436e-8aef-e688c4d07f39 req-63a49f70-b49b-4538-861c-00b69e45d6e2 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-749fffc3-bc4e-436e-8aef-e688c4d07f39 req-63a49f70-b49b-4538-861c-00b69e45d6e2 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:22:25 user nova-compute[75305]: WARNING nova.compute.manager [req-749fffc3-bc4e-436e-8aef-e688c4d07f39 req-63a49f70-b49b-4538-861c-00b69e45d6e2 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:22:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:25 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance destroyed successfully.
Nov 14 08:22:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b274db6-e390-4b6d-8173-57a772513fa3 req-eabb7b93-b978-4828-9465-4945ce8fc60c service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b274db6-e390-4b6d-8173-57a772513fa3 req-eabb7b93-b978-4828-9465-4945ce8fc60c service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b274db6-e390-4b6d-8173-57a772513fa3 req-eabb7b93-b978-4828-9465-4945ce8fc60c service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b274db6-e390-4b6d-8173-57a772513fa3 req-eabb7b93-b978-4828-9465-4945ce8fc60c service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b274db6-e390-4b6d-8173-57a772513fa3 req-eabb7b93-b978-4828-9465-4945ce8fc60c service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:22:27 user nova-compute[75305]: WARNING nova.compute.manager [req-5b274db6-e390-4b6d-8173-57a772513fa3 req-eabb7b93-b978-4828-9465-4945ce8fc60c service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-changed-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Refreshing instance network info cache due to event network-changed-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] Acquiring lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] Acquired lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Refreshing network info cache for port d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updated VIF entry in instance network info cache for port d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.network.neutron [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updating instance_info_cache with network_info: [{"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-34aa21a9-3872-425c-a907-a2eaa5c9e464 req-1599a899-06cb-48be-9093-8310d1f642a5 service nova] Releasing lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:27 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'flavor' on Instance uuid df425ccc-d6d2-4fdf-802b-41e35fe5d884 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.110s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:28 user nova-compute[75305]: INFO nova.compute.manager [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Attaching volume beb21c60-9122-4f51-9144-d3ea9c691996 to /dev/vdb
Nov 14 08:22:28 user nova-compute[75305]: DEBUG os_brick.utils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa1b12-589e-4517-af69-455f4cfabc72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd109785-d35a-4418-8828-711c411ddf74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56342c4-06b6-4fc5-96fc-d8d800d0c4a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a38a78-012b-470f-8e61-518118e08ed1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:22:28 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4d05e4-4628-4cdc-8cad-2b91144c7f9d]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG os_brick.utils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updating existing volume attachment record: 5b156a10-ad4b-43a6-ba5f-e70dddb99717 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:28 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG nova.compute.manager [None req-72f02acc-0624-4999-a1c3-35347287d456 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:22:29 user nova-compute[75305]: WARNING nova.compute.manager [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:22:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:22:29 user nova-compute[75305]: WARNING nova.compute.manager [req-89192c19-b4c2-4642-b1de-325eefe6be64 req-b3abb36e-706d-4f71-8d04-135c70cfe3fe service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:22:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:22:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8194MB free_disk=24.706939697265625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5b229490-ec43-495b-88f4-b829dd71c07b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ed790e9a-940e-4541-8d5a-832398783c0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ceafdd37-52d0-4350-80cf-01c381b6fffd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:22:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIrOvLJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:22:33 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:22:33 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:22:33 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae648a36-8210-4785-8576-f4d84b40f41b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:22:33 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb7121-a37e-4666-ad20-e8b9eb19b503]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996] added
Nov 14 08:22:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b10395-fca7-4fc8-ba6d-52f34fc63063]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4335ac12-0955-416d-8abf-5f7b81ad438d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIrOvLJC {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tIrOvLJC" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275a5ec-6980-4a08-a479-59276054b594]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tIrOvLJC'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5634c341-5f67-471d-9f13-6ac090609ab0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd7e574-f82e-4c82-aa12-9fa5fdcd9f52]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[876cda3c-83e0-420c-9e6f-435f6420ea23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260]
Nov 14 08:22:33 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260] successful.
Nov 14 08:22:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5de1cf-89e8-4dd3-b107-ad789645eab9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50b14be-7b8e-442f-a299-1c98a0a5507a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 (non-flash)
Nov 14 08:22:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f319a6-c4cb-49f6-8109-a6c967d3fd23]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5e23822-868e-4437-b87b-487179175d6c] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIrOvLJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23032613033343937', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032613033343937', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'flavor' on Instance uuid df425ccc-d6d2-4fdf-802b-41e35fe5d884 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:22:34 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:22:34 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:22:34 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:22:34 user nova-compute[75305]:   <serial>beb21c60-9122-4f51-9144-d3ea9c691996</serial>
Nov 14 08:22:34 user nova-compute[75305]: </disk>
Nov 14 08:22:34 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [{"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-f5e23822-868e-4437-b87b-487179175d6c" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:22:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:22:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:22:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] No VIF found with MAC fa:16:3e:00:ee:e4, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:22:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c72c2d1d-5cd4-4573-a75d-f639278390aa tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.135s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:37 user nova-compute[75305]: INFO nova.compute.manager [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Detaching volume beb21c60-9122-4f51-9144-d3ea9c691996
Nov 14 08:22:37 user nova-compute[75305]: INFO nova.virt.block_device [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Attempting to driver detach volume beb21c60-9122-4f51-9144-d3ea9c691996 from mountpoint /dev/vdb
Nov 14 08:22:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Attempting to detach device vdb from instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:22:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:22:37 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:22:37 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:22:37 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:22:37 user nova-compute[75305]:   <serial>beb21c60-9122-4f51-9144-d3ea9c691996</serial>
Nov 14 08:22:37 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:22:37 user nova-compute[75305]: </disk>
Nov 14 08:22:37 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:22:37 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully detached device vdb from instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 from the persistent domain config.
Nov 14 08:22:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:22:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:22:37 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:22:37 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:22:37 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:22:37 user nova-compute[75305]:   <serial>beb21c60-9122-4f51-9144-d3ea9c691996</serial>
Nov 14 08:22:37 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:22:37 user nova-compute[75305]: </disk>
Nov 14 08:22:37 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:22:37 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:22:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "ed790e9a-940e-4541-8d5a-832398783c0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "ed790e9a-940e-4541-8d5a-832398783c0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:52 user nova-compute[75305]: INFO nova.compute.manager [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Terminating instance
Nov 14 08:22:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-06d23f6f-7ac8-4446-9d53-0360c260b31a req-8f7572a7-005c-43d0-b38f-450a552dbc77 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received event network-vif-unplugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-06d23f6f-7ac8-4446-9d53-0360c260b31a req-8f7572a7-005c-43d0-b38f-450a552dbc77 service nova] Acquiring lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-06d23f6f-7ac8-4446-9d53-0360c260b31a req-8f7572a7-005c-43d0-b38f-450a552dbc77 service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-06d23f6f-7ac8-4446-9d53-0360c260b31a req-8f7572a7-005c-43d0-b38f-450a552dbc77 service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-06d23f6f-7ac8-4446-9d53-0360c260b31a req-8f7572a7-005c-43d0-b38f-450a552dbc77 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] No waiting events found dispatching network-vif-unplugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:22:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-06d23f6f-7ac8-4446-9d53-0360c260b31a req-8f7572a7-005c-43d0-b38f-450a552dbc77 service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received event network-vif-unplugged-b8f6a787-9cc9-41a8-b827-d50b85439027 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:22:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Instance destroyed successfully.
Nov 14 08:22:53 user nova-compute[75305]: DEBUG nova.objects.instance [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lazy-loading 'resources' on Instance uuid ed790e9a-940e-4541-8d5a-832398783c0d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-830357312',display_name='tempest-VolumesActionsTest-instance-830357312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-830357312',id=38,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:21:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2478d3b11c2b41e580ffcc1d3a1215de',ramdisk_id='',reservation_id='r-urrmgbly',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1814532565',owner_user_name='tempest-VolumesActionsTest-1814532565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:21:09Z,user_data=None,user_id='5997915995004b44ba724d220b5c46a0',uuid=ed790e9a-940e-4541-8d5a-832398783c0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converting VIF {"id": "b8f6a787-9cc9-41a8-b827-d50b85439027", "address": "fa:16:3e:5e:f1:af", "network": {"id": "d260d45e-630e-49ad-8e63-703404ee55d9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1376355262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2478d3b11c2b41e580ffcc1d3a1215de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8f6a787-9c", "ovs_interfaceid": "b8f6a787-9cc9-41a8-b827-d50b85439027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f1:af,bridge_name='br-int',has_traffic_filtering=True,id=b8f6a787-9cc9-41a8-b827-d50b85439027,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f6a787-9c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG os_vif [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f1:af,bridge_name='br-int',has_traffic_filtering=True,id=b8f6a787-9cc9-41a8-b827-d50b85439027,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f6a787-9c') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8f6a787-9c, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23b8d584-0f7b-41f5-921f-9274bf15deb2) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:22:53 user nova-compute[75305]: INFO os_vif [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:f1:af,bridge_name='br-int',has_traffic_filtering=True,id=b8f6a787-9cc9-41a8-b827-d50b85439027,network=Network(d260d45e-630e-49ad-8e63-703404ee55d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8f6a787-9c')
Nov 14 08:22:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Deleting instance files /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d_del
Nov 14 08:22:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Deletion of /opt/stack/data/nova/instances/ed790e9a-940e-4541-8d5a-832398783c0d_del complete
Nov 14 08:22:53 user nova-compute[75305]: INFO nova.compute.manager [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 14 08:22:53 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:22:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:22:54 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Took 0.77 seconds to deallocate network for instance.
Nov 14 08:22:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:54 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Deleted allocations for instance ed790e9a-940e-4541-8d5a-832398783c0d
Nov 14 08:22:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-47e9aaa5-a721-4064-97e3-4b3afaadcb57 tempest-VolumesActionsTest-1814532565 tempest-VolumesActionsTest-1814532565-project-member] Lock "ed790e9a-940e-4541-8d5a-832398783c0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-001e1a85-af9c-4fe0-8fca-b62eec8e75fa req-1fe478d6-7988-4309-bfee-847d55d00cdc service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received event network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-001e1a85-af9c-4fe0-8fca-b62eec8e75fa req-1fe478d6-7988-4309-bfee-847d55d00cdc service nova] Acquiring lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-001e1a85-af9c-4fe0-8fca-b62eec8e75fa req-1fe478d6-7988-4309-bfee-847d55d00cdc service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-001e1a85-af9c-4fe0-8fca-b62eec8e75fa req-1fe478d6-7988-4309-bfee-847d55d00cdc service nova] Lock "ed790e9a-940e-4541-8d5a-832398783c0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:22:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-001e1a85-af9c-4fe0-8fca-b62eec8e75fa req-1fe478d6-7988-4309-bfee-847d55d00cdc service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] No waiting events found dispatching network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:22:54 user nova-compute[75305]: WARNING nova.compute.manager [req-001e1a85-af9c-4fe0-8fca-b62eec8e75fa req-1fe478d6-7988-4309-bfee-847d55d00cdc service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received unexpected event network-vif-plugged-b8f6a787-9cc9-41a8-b827-d50b85439027 for instance with vm_state deleted and task_state None.
Nov 14 08:22:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-001e1a85-af9c-4fe0-8fca-b62eec8e75fa req-1fe478d6-7988-4309-bfee-847d55d00cdc service nova] [instance: ed790e9a-940e-4541-8d5a-832398783c0d] Received event network-vif-deleted-b8f6a787-9cc9-41a8-b827-d50b85439027 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:22:57 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 is timed out.
Nov 14 08:22:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully detached device vdb from instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 from the live domain config.
Nov 14 08:22:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tIrOvLJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:22:57 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7381343a-027e-486b-9984-ac660b5c8397]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:22:57 user nova-compute[75305]: No targets found.
Nov 14 08:22:57 user nova-compute[75305]: iSNS:
Nov 14 08:22:57 user nova-compute[75305]: No targets found.
Nov 14 08:22:57 user nova-compute[75305]: STATIC:
Nov 14 08:22:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68
Nov 14 08:22:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:22:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:22:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:22:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:22:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:22:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996
Nov 14 08:22:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:22:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:22:57 user nova-compute[75305]: FIRMWARE:
Nov 14 08:22:57 user nova-compute[75305]: No targets found.
Nov 14 08:22:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:22:57 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:22:57 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a2065f-4ff1-455e-8dad-0400b8f94235]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d44d952-d7da-4d7c-8e4d-5a4a18f98db1]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:22:57 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:22:57 user nova-compute[75305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 (non-flash)
Nov 14 08:22:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:22:57 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:22:57 user nova-compute[75305]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 (non-flash)
Nov 14 08:22:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4428acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acab9d1-1cd4-4510-81eb-cc7897b6ede2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89753ba0-fe6b-4bff-8364-39e459bb1782]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2e950c-13c7-48e7-b670-2df31bd2a846]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6ad03e-8a45-4513-bb6c-819f3737d3b3]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab383979-d7ee-472f-978d-ffa1855ffa35]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6b90a7-963e-48dc-b337-4bd3241f9a99]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260]
Nov 14 08:22:58 user nova-compute[75305]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996, portal: 172.16.0.220,3260] successful.
Nov 14 08:22:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beb21c60-9122-4f51-9144-d3ea9c691996 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a941038-967f-4554-b403-58e9ba1a96a6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] <== disconnect_volume: return (365ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'flavor' on Instance uuid df425ccc-d6d2-4fdf-802b-41e35fe5d884 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:22:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e29afb2e-5bd5-462d-81d9-0ddf1d2b409d tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.744s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "ceafdd37-52d0-4350-80cf-01c381b6fffd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:02 user nova-compute[75305]: INFO nova.compute.manager [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Terminating instance
Nov 14 08:23:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-78b29fb1-d1fa-423e-aac0-a5707c8c7a6f req-f733ed1f-4832-4a1d-a86c-83c6120d9bc1 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received event network-vif-unplugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-78b29fb1-d1fa-423e-aac0-a5707c8c7a6f req-f733ed1f-4832-4a1d-a86c-83c6120d9bc1 service nova] Acquiring lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-78b29fb1-d1fa-423e-aac0-a5707c8c7a6f req-f733ed1f-4832-4a1d-a86c-83c6120d9bc1 service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-78b29fb1-d1fa-423e-aac0-a5707c8c7a6f req-f733ed1f-4832-4a1d-a86c-83c6120d9bc1 service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-78b29fb1-d1fa-423e-aac0-a5707c8c7a6f req-f733ed1f-4832-4a1d-a86c-83c6120d9bc1 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] No waiting events found dispatching network-vif-unplugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:23:02 user nova-compute[75305]: DEBUG nova.compute.manager [req-78b29fb1-d1fa-423e-aac0-a5707c8c7a6f req-f733ed1f-4832-4a1d-a86c-83c6120d9bc1 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received event network-vif-unplugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:23:03 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Instance destroyed successfully.
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lazy-loading 'resources' on Instance uuid ceafdd37-52d0-4350-80cf-01c381b6fffd {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:21:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1241589857',display_name='tempest-VolumesActionsTest-instance-1241589857',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1241589857',id=39,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28cfda668593413b9db2ce366dd23017',ramdisk_id='',reservation_id='r-3nn9gdjd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-520211291',owner_user_name='tempest-VolumesActionsTest-520211291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:21:14Z,user_data=None,user_id='6ab16b506cdf4f4f889b9cbe639967b1',uuid=ceafdd37-52d0-4350-80cf-01c381b6fffd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Converting VIF {"id": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "address": "fa:16:3e:a8:c4:ac", "network": {"id": "e137d83e-5a78-4742-a716-179e614c7ccb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392396710-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28cfda668593413b9db2ce366dd23017", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d23cbf-ba", "ovs_interfaceid": "d1d23cbf-ba15-4ce9-ab1b-bd631de7f441", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1d23cbf-ba15-4ce9-ab1b-bd631de7f441,network=Network(e137d83e-5a78-4742-a716-179e614c7ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d23cbf-ba') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG os_vif [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1d23cbf-ba15-4ce9-ab1b-bd631de7f441,network=Network(e137d83e-5a78-4742-a716-179e614c7ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d23cbf-ba') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1d23cbf-ba, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63720b10-064a-42ea-9da4-4210fa0f116f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:23:03 user nova-compute[75305]: INFO os_vif [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:c4:ac,bridge_name='br-int',has_traffic_filtering=True,id=d1d23cbf-ba15-4ce9-ab1b-bd631de7f441,network=Network(e137d83e-5a78-4742-a716-179e614c7ccb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d23cbf-ba')
Nov 14 08:23:03 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Deleting instance files /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd_del
Nov 14 08:23:03 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Deletion of /opt/stack/data/nova/instances/ceafdd37-52d0-4350-80cf-01c381b6fffd_del complete
Nov 14 08:23:03 user nova-compute[75305]: INFO nova.compute.manager [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 08:23:03 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:23:03 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Took 0.43 seconds to deallocate network for instance.
Nov 14 08:23:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-a5f10ed5-1db0-4e53-bf29-54afc2f764b2 req-a37dfd29-98dd-4528-9a4c-561902311307 service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received event network-vif-deleted-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:23:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:03 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Deleted allocations for instance ceafdd37-52d0-4350-80cf-01c381b6fffd
Nov 14 08:23:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79211b88-8972-409d-9c8e-68d9d85bdbf9 tempest-VolumesActionsTest-520211291 tempest-VolumesActionsTest-520211291-project-member] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.751s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-f8416028-9d69-4263-92c5-ccabf6fbde0b req-59b1a8d4-4c82-401d-9cfe-51f3b771c85b service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received event network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f8416028-9d69-4263-92c5-ccabf6fbde0b req-59b1a8d4-4c82-401d-9cfe-51f3b771c85b service nova] Acquiring lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f8416028-9d69-4263-92c5-ccabf6fbde0b req-59b1a8d4-4c82-401d-9cfe-51f3b771c85b service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f8416028-9d69-4263-92c5-ccabf6fbde0b req-59b1a8d4-4c82-401d-9cfe-51f3b771c85b service nova] Lock "ceafdd37-52d0-4350-80cf-01c381b6fffd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-f8416028-9d69-4263-92c5-ccabf6fbde0b req-59b1a8d4-4c82-401d-9cfe-51f3b771c85b service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] No waiting events found dispatching network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:23:04 user nova-compute[75305]: WARNING nova.compute.manager [req-f8416028-9d69-4263-92c5-ccabf6fbde0b req-59b1a8d4-4c82-401d-9cfe-51f3b771c85b service nova] [instance: ceafdd37-52d0-4350-80cf-01c381b6fffd] Received unexpected event network-vif-plugged-d1d23cbf-ba15-4ce9-ab1b-bd631de7f441 for instance with vm_state deleted and task_state None.
Nov 14 08:23:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:23:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:23:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:23:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:23:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:23:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:23:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-changed-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Refreshing instance network info cache due to event network-changed-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] Acquiring lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] Acquired lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Refreshing network info cache for port d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:28 user nova-compute[75305]: INFO nova.compute.manager [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Terminating instance
Nov 14 08:23:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updated VIF entry in instance network info cache for port d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG nova.network.neutron [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updating instance_info_cache with network_info: [{"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-52b57f7a-fa1c-4cd2-b739-094b4f153a21 req-9eac6f80-49d7-4264-b639-c5956b11d65a service nova] Releasing lock "refresh_cache-df425ccc-d6d2-4fdf-802b-41e35fe5d884" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:23:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Instance destroyed successfully.
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.objects.instance [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'resources' on Instance uuid df425ccc-d6d2-4fdf-802b-41e35fe5d884 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:20:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-787736376',display_name='tempest-TestStampPattern-server-787736376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-787736376',id=37,image_ref='39b3f434-5a7d-4c20-a64b-aaba1d2f1507',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDECpqXZ39yJhKNBdtHyasJhkEpTXP1jf3ZW+cfIJ2zbLVCmgEy5+PFQBkFXCyo6idt7/qq9uAbj+UgLZkJ9h0TNVNbnRQfF91Cg5e9J2qAT5cWwGnjSjvl8hUs4n/TyWg==',key_name='tempest-TestStampPattern-1143433304',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:20:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38b3c6c530ef4c20b176189616d71c56',ramdisk_id='',reservation_id='r-2qxnpvf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5b229490-ec43-495b-88f4-b829dd71c07b',image_min_disk='1',image_min_ram='0',image_owner_id='38b3c6c530ef4c20b176189616d71c56',image_owner_project_name='tempest-TestStampPattern-1608752450',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1608752450-project-member',image_user_id='b0b561dad6d74acfa63122951faf8f37',owner_project_name='tempest-TestStampPattern-1608752450',owner_user_name='tempest-TestStampPattern-1608752450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:20:44Z,user_data=None,user_id='b0b561dad6d74acfa63122951faf8f37',uuid=df425ccc-d6d2-4fdf-802b-41e35fe5d884,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converting VIF {"id": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "address": "fa:16:3e:00:ee:e4", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd86e55d4-bc", "ovs_interfaceid": "d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:ee:e4,bridge_name='br-int',has_traffic_filtering=True,id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86e55d4-bc') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG os_vif [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:ee:e4,bridge_name='br-int',has_traffic_filtering=True,id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86e55d4-bc') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd86e55d4-bc, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cd79edb-b932-4301-a640-635c0007052c) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:23:29 user nova-compute[75305]: INFO os_vif [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:ee:e4,bridge_name='br-int',has_traffic_filtering=True,id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd86e55d4-bc')
Nov 14 08:23:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Deleting instance files /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884_del
Nov 14 08:23:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Deletion of /opt/stack/data/nova/instances/df425ccc-d6d2-4fdf-802b-41e35fe5d884_del complete
Nov 14 08:23:29 user nova-compute[75305]: INFO nova.compute.manager [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:29 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid 'df425ccc-d6d2-4fdf-802b-41e35fe5d884' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid 'df425ccc-d6d2-4fdf-802b-41e35fe5d884' (instance-00000025)
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-e456d20e-f480-4bbf-b3a4-6f17d37c57ce req-fe3684e8-5669-444a-9d65-463c74ca3453 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-vif-deleted-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:29 user nova-compute[75305]: INFO nova.compute.manager [req-e456d20e-f480-4bbf-b3a4-6f17d37c57ce req-fe3684e8-5669-444a-9d65-463c74ca3453 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Neutron deleted interface d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646; detaching it from the instance and deleting it from the info cache
Nov 14 08:23:29 user nova-compute[75305]: DEBUG nova.network.neutron [req-e456d20e-f480-4bbf-b3a4-6f17d37c57ce req-fe3684e8-5669-444a-9d65-463c74ca3453 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:23:29 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Took 0.61 seconds to deallocate network for instance.
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-e456d20e-f480-4bbf-b3a4-6f17d37c57ce req-fe3684e8-5669-444a-9d65-463c74ca3453 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Detach interface failed, port_id=d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646, reason: Instance df425ccc-d6d2-4fdf-802b-41e35fe5d884 could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-vif-unplugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] No waiting events found dispatching network-vif-unplugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:23:30 user nova-compute[75305]: WARNING nova.compute.manager [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received unexpected event network-vif-unplugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 for instance with vm_state deleted and task_state None.
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received event network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] Acquiring lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] No waiting events found dispatching network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:23:30 user nova-compute[75305]: WARNING nova.compute.manager [req-5dd897d7-607d-41e1-bb5c-50cdbe57dd79 req-dc36c60d-c4a0-4f41-967d-07f0d7d156c2 service nova] [instance: df425ccc-d6d2-4fdf-802b-41e35fe5d884] Received unexpected event network-vif-plugged-d86e55d4-bc8d-4f8d-9c72-2b8aecc6b646 for instance with vm_state deleted and task_state None.
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:23:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.953s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:23:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8469MB free_disk=24.759361267089844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:31 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Deleted allocations for instance df425ccc-d6d2-4fdf-802b-41e35fe5d884
Nov 14 08:23:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-09a5c260-0f62-4de3-a4ed-f871a441aa73 tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "df425ccc-d6d2-4fdf-802b-41e35fe5d884" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.674s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5b229490-ec43-495b-88f4-b829dd71c07b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:23:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Updating instance_info_cache with network_info: [{"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-36cc9bba-70f0-4bcd-bf54-81cfd335f797" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:23:34 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:23:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:23:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:23:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "a05477af-47a7-4ceb-a214-59f70d731c99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "a05477af-47a7-4ceb-a214-59f70d731c99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:23:43 user nova-compute[75305]: INFO nova.compute.claims [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Claim successful on node user
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.network.neutron [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:23:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:23:43 user nova-compute[75305]: INFO nova.virt.block_device [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Booting with volume snapshot b7bc853a-6b34-4fae-b4ed-d2b4fca50130 at /dev/vda
Nov 14 08:23:43 user nova-compute[75305]: DEBUG nova.policy [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347d5cb8a22e49948b1c210d2d62ce2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a5b13c6fbb417184c70151551cd2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:23:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Successfully created port: 5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Successfully updated port: 5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "refresh_cache-a05477af-47a7-4ceb-a214-59f70d731c99" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquired lock "refresh_cache-a05477af-47a7-4ceb-a214-59f70d731c99" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received event network-changed-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Refreshing instance network info cache due to event network-changed-5195f494-1a01-4620-9886-f528dc176be9. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] Acquiring lock "refresh_cache-a05477af-47a7-4ceb-a214-59f70d731c99" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Updating instance_info_cache with network_info: [{"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Releasing lock "refresh_cache-a05477af-47a7-4ceb-a214-59f70d731c99" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Instance network_info: |[{"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] Acquired lock "refresh_cache-a05477af-47a7-4ceb-a214-59f70d731c99" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Refreshing network info cache for port 5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Updated VIF entry in instance network info cache for port 5195f494-1a01-4620-9886-f528dc176be9. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Updating instance_info_cache with network_info: [{"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:23:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cda61674-2062-44e7-bc28-81c3f1d05dfb req-8b3016e0-cea6-4d11-aa6d-17aa167c23e1 service nova] Releasing lock "refresh_cache-a05477af-47a7-4ceb-a214-59f70d731c99" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:23:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG os_brick.utils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[519b0c90-ade2-4eb4-9136-df07e173a72d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf6df24-4550-4c69-8cbe-8d0b36386375]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5084dd45-c714-487a-8789-09203d82ce63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce658c9-ee63-44b9-8afc-ee45d4d9f811]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:23:49 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:23:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4c5275-10d0-4067-a1c2-16a15a09472e]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG os_brick.utils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:23:49 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Updating existing volume attachment record: 8776f72c-047e-4999-bee3-ab7c8cad3db5 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:23:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:23:55 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Creating image(s)
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Ensure instance console log exists: /opt/stack/data/nova/instances/a05477af-47a7-4ceb-a214-59f70d731c99/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Start _get_guest_xml network_info=[{"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '8776f72c-047e-4999-bee3-ab7c8cad3db5', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikDyGaVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a05477af-47a7-4ceb-a214-59f70d731c99', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9', 'serial': 'c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:23:55 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:23:55 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikDyGaVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:23:55 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:23:55 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:23:55 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e468e00-cd9f-47e7-9453-3622b6fafa5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:23:55 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[692cb8a4-dc84-4fce-82bc-d990bb7a87f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9] added
Nov 14 08:23:55 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb96b14-572c-442f-bba4-cd56923e4168]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.062s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d662aa-ae36-41e6-8610-59902aabbfd9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikDyGaVC {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ikDyGaVC" returned: 0 in 0.097s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be43bd4-c416-4974-b5c2-a610daee946b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ikDyGaVC'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.081s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e287a58-5ef7-47aa-8d48-4d007005f7f3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12515b2f-6832-4451-9460-daaea8976f3b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88edb346-7923-4d52-bc80-1df321691182 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88edb346-7923-4d52-bc80-1df321691182 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88edb346-7923-4d52-bc80-1df321691182 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.128s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba80ff0a-0de7-4422-98c3-2d1c8f995b80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260]
Nov 14 08:23:56 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260] successful.
Nov 14 08:23:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1442c3df-403c-4207-99e8-0a2eed743646]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[882b2ab4-a95b-4575-a222-b14278a1172c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88edb346-7923-4d52-bc80-1df321691182 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88edb346-7923-4d52-bc80-1df321691182 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88edb346-7923-4d52-bc80-1df321691182 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:23:56 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.607s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2b4607-7777-478f-a08c-0df929dec4ed]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:23:56 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikDyGaVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.642s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== connect_volume: return (1644ms) {'type': 'block', 'scsi_wwn': '23736383962613661', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736383962613661', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109733247',display_name='tempest-TestVolumeBootPattern-server-109733247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109733247',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-k3baed4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:23:44Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=a05477af-47a7-4ceb-a214-59f70d731c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0b:8a,bridge_name='br-int',has_traffic_filtering=True,id=5195f494-1a01-4620-9886-f528dc176be9,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5195f494-1a') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'pci_devices' on Instance uuid a05477af-47a7-4ceb-a214-59f70d731c99 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:23:57 user nova-compute[75305]:   <uuid>a05477af-47a7-4ceb-a214-59f70d731c99</uuid>
Nov 14 08:23:57 user nova-compute[75305]:   <name>instance-00000028</name>
Nov 14 08:23:57 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:23:57 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:23:57 user nova-compute[75305]:   <metadata>
Nov 14 08:23:57 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:23:57 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:23:57 user nova-compute[75305]:       <nova:name>tempest-TestVolumeBootPattern-server-109733247</nova:name>
Nov 14 08:23:57 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:23:55</nova:creationTime>
Nov 14 08:23:57 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:23:57 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:23:57 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:23:57 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:23:57 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:23:57 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:23:57 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:23:57 user nova-compute[75305]:       <nova:owner>
Nov 14 08:23:57 user nova-compute[75305]:         <nova:user uuid="347d5cb8a22e49948b1c210d2d62ce2b">tempest-TestVolumeBootPattern-1297430060-project-member</nova:user>
Nov 14 08:23:57 user nova-compute[75305]:         <nova:project uuid="37a5b13c6fbb417184c70151551cd2a4">tempest-TestVolumeBootPattern-1297430060</nova:project>
Nov 14 08:23:57 user nova-compute[75305]:       </nova:owner>
Nov 14 08:23:57 user nova-compute[75305]:       <nova:ports>
Nov 14 08:23:57 user nova-compute[75305]:         <nova:port uuid="5195f494-1a01-4620-9886-f528dc176be9">
Nov 14 08:23:57 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 08:23:57 user nova-compute[75305]:         </nova:port>
Nov 14 08:23:57 user nova-compute[75305]:       </nova:ports>
Nov 14 08:23:57 user nova-compute[75305]:     </nova:instance>
Nov 14 08:23:57 user nova-compute[75305]:   </metadata>
Nov 14 08:23:57 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:23:57 user nova-compute[75305]:     <system>
Nov 14 08:23:57 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:23:57 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:23:57 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:23:57 user nova-compute[75305]:       <entry name="serial">a05477af-47a7-4ceb-a214-59f70d731c99</entry>
Nov 14 08:23:57 user nova-compute[75305]:       <entry name="uuid">a05477af-47a7-4ceb-a214-59f70d731c99</entry>
Nov 14 08:23:57 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:23:57 user nova-compute[75305]:     </system>
Nov 14 08:23:57 user nova-compute[75305]:   </sysinfo>
Nov 14 08:23:57 user nova-compute[75305]:   <os>
Nov 14 08:23:57 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:23:57 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:23:57 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:23:57 user nova-compute[75305]:   </os>
Nov 14 08:23:57 user nova-compute[75305]:   <features>
Nov 14 08:23:57 user nova-compute[75305]:     <acpi/>
Nov 14 08:23:57 user nova-compute[75305]:     <apic/>
Nov 14 08:23:57 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:23:57 user nova-compute[75305]:   </features>
Nov 14 08:23:57 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:23:57 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:23:57 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:23:57 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:23:57 user nova-compute[75305]:   </clock>
Nov 14 08:23:57 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:23:57 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:23:57 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:23:57 user nova-compute[75305]:   </cpu>
Nov 14 08:23:57 user nova-compute[75305]:   <devices>
Nov 14 08:23:57 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:23:57 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:23:57 user nova-compute[75305]:       <source dev="/dev/sdd"/>
Nov 14 08:23:57 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:23:57 user nova-compute[75305]:       <serial>c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9</serial>
Nov 14 08:23:57 user nova-compute[75305]:     </disk>
Nov 14 08:23:57 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:23:57 user nova-compute[75305]:       <mac address="fa:16:3e:c5:0b:8a"/>
Nov 14 08:23:57 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:23:57 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:23:57 user nova-compute[75305]:       <target dev="tap5195f494-1a"/>
Nov 14 08:23:57 user nova-compute[75305]:     </interface>
Nov 14 08:23:57 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:23:57 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/a05477af-47a7-4ceb-a214-59f70d731c99/console.log" append="off"/>
Nov 14 08:23:57 user nova-compute[75305]:     </serial>
Nov 14 08:23:57 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:23:57 user nova-compute[75305]:     <video>
Nov 14 08:23:57 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:23:57 user nova-compute[75305]:     </video>
Nov 14 08:23:57 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:23:57 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:23:57 user nova-compute[75305]:     </rng>
Nov 14 08:23:57 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:23:57 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:23:57 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:23:57 user nova-compute[75305]:     </memballoon>
Nov 14 08:23:57 user nova-compute[75305]:   </devices>
Nov 14 08:23:57 user nova-compute[75305]: </domain>
Nov 14 08:23:57 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109733247',display_name='tempest-TestVolumeBootPattern-server-109733247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109733247',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-k3baed4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:23:44Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=a05477af-47a7-4ceb-a214-59f70d731c99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0b:8a,bridge_name='br-int',has_traffic_filtering=True,id=5195f494-1a01-4620-9886-f528dc176be9,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5195f494-1a') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG os_vif [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0b:8a,bridge_name='br-int',has_traffic_filtering=True,id=5195f494-1a01-4620-9886-f528dc176be9,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5195f494-1a') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e5afd50-bb38-58d3-bf9d-82cc5beb9c1e', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5195f494-1a, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5195f494-1a, col_values=(('qos', UUID('cdb6a08c-0ad3-4e5d-b47d-ea83de39e155')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5195f494-1a, col_values=(('external_ids', {'iface-id': '5195f494-1a01-4620-9886-f528dc176be9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:0b:8a', 'vm-uuid': 'a05477af-47a7-4ceb-a214-59f70d731c99'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:57 user nova-compute[75305]: INFO os_vif [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0b:8a,bridge_name='br-int',has_traffic_filtering=True,id=5195f494-1a01-4620-9886-f528dc176be9,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5195f494-1a')
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:23:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No VIF found with MAC fa:16:3e:c5:0b:8a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:23:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ffa97268-8621-45ab-8443-9757ab1f9003 req-9118ec3c-9752-47cc-b3f8-946fecd3cf8f service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received event network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ffa97268-8621-45ab-8443-9757ab1f9003 req-9118ec3c-9752-47cc-b3f8-946fecd3cf8f service nova] Acquiring lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ffa97268-8621-45ab-8443-9757ab1f9003 req-9118ec3c-9752-47cc-b3f8-946fecd3cf8f service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ffa97268-8621-45ab-8443-9757ab1f9003 req-9118ec3c-9752-47cc-b3f8-946fecd3cf8f service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-ffa97268-8621-45ab-8443-9757ab1f9003 req-9118ec3c-9752-47cc-b3f8-946fecd3cf8f service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] No waiting events found dispatching network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:23:59 user nova-compute[75305]: WARNING nova.compute.manager [req-ffa97268-8621-45ab-8443-9757ab1f9003 req-9118ec3c-9752-47cc-b3f8-946fecd3cf8f service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received unexpected event network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 for instance with vm_state building and task_state spawning.
Nov 14 08:23:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:23:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-cd262967-efe9-4c6d-afdc-45a08d3907aa req-e6dfbcc4-4dde-4608-ab89-05294e2ab489 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received event network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cd262967-efe9-4c6d-afdc-45a08d3907aa req-e6dfbcc4-4dde-4608-ab89-05294e2ab489 service nova] Acquiring lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cd262967-efe9-4c6d-afdc-45a08d3907aa req-e6dfbcc4-4dde-4608-ab89-05294e2ab489 service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cd262967-efe9-4c6d-afdc-45a08d3907aa req-e6dfbcc4-4dde-4608-ab89-05294e2ab489 service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-cd262967-efe9-4c6d-afdc-45a08d3907aa req-e6dfbcc4-4dde-4608-ab89-05294e2ab489 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] No waiting events found dispatching network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:24:01 user nova-compute[75305]: WARNING nova.compute.manager [req-cd262967-efe9-4c6d-afdc-45a08d3907aa req-e6dfbcc4-4dde-4608-ab89-05294e2ab489 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received unexpected event network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 for instance with vm_state building and task_state spawning.
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:24:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Instance spawned successfully.
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:24:01 user nova-compute[75305]: INFO nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Took 6.09 seconds to spawn the instance on the hypervisor.
Nov 14 08:24:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:24:01 user nova-compute[75305]: INFO nova.compute.manager [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Took 18.25 seconds to build instance.
Nov 14 08:24:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-5e30dc99-4677-41bd-b3c6-dd97589da3a3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "a05477af-47a7-4ceb-a214-59f70d731c99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.344s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:15 user nova-compute[75305]: INFO nova.compute.manager [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Terminating instance
Nov 14 08:24:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:24:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-2e0c9082-a996-49e5-b29e-ccef89e08c85 req-92b47134-a2b8-4405-bf0c-3abb1eb59edd service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2e0c9082-a996-49e5-b29e-ccef89e08c85 req-92b47134-a2b8-4405-bf0c-3abb1eb59edd service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2e0c9082-a996-49e5-b29e-ccef89e08c85 req-92b47134-a2b8-4405-bf0c-3abb1eb59edd service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2e0c9082-a996-49e5-b29e-ccef89e08c85 req-92b47134-a2b8-4405-bf0c-3abb1eb59edd service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-2e0c9082-a996-49e5-b29e-ccef89e08c85 req-92b47134-a2b8-4405-bf0c-3abb1eb59edd service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-2e0c9082-a996-49e5-b29e-ccef89e08c85 req-92b47134-a2b8-4405-bf0c-3abb1eb59edd service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-unplugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Instance destroyed successfully.
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.objects.instance [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'resources' on Instance uuid 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1507680698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1507680698',id=36,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:20:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-a5s8xoyv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:22:29Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=64b4867a-3fba-49db-b4c7-2a92bfa4d0a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "22af325a-a511-4313-a09e-4d0804a62b0b", "address": "fa:16:3e:b5:b1:38", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22af325a-a5", "ovs_interfaceid": "22af325a-a511-4313-a09e-4d0804a62b0b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_vif [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22af325a-a5, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0b16085-3e2d-400f-8a4d-6e8731d45950) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:24:16 user nova-compute[75305]: INFO os_vif [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=22af325a-a511-4313-a09e-4d0804a62b0b,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22af325a-a5')
Nov 14 08:24:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raVmMnJb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:24:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[131330c2-886d-4ed1-a4d1-e75a59a41367]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:24:16 user nova-compute[75305]: No targets found.
Nov 14 08:24:16 user nova-compute[75305]: iSNS:
Nov 14 08:24:16 user nova-compute[75305]: No targets found.
Nov 14 08:24:16 user nova-compute[75305]: STATIC:
Nov 14 08:24:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9
Nov 14 08:24:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:24:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:24:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68
Nov 14 08:24:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:24:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:24:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:24:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:24:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:24:16 user nova-compute[75305]: FIRMWARE:
Nov 14 08:24:16 user nova-compute[75305]: No targets found.
Nov 14 08:24:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:24:16 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:24:16 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29923bfb-d021-441c-b8c5-1f04d838f0f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0f065e-4836-4a59-a85c-44eab851d04c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:24:16 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:24:16 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:24:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:24:16 user nova-compute[75305]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 (non-flash)
Nov 14 08:24:16 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:24:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf20627be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43f5da1-a0ed-43d1-b367-a737e7afd5a5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2829b928-4af5-41f2-93d4-2b3bd650db86]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf0fc46-8bd6-4e16-ad63-a9900d808571]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f09ec8-7ef3-4f9f-b3cc-3c07ad83ec29]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf8ab888-93dc7e6955b5c1bf', '/dev/disk/by-id/scsi-23933646337653639', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f8ab888') {{(pid=86224) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 08:24:16 user nova-compute[75305]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf8ab888-93dc7e6955b5c1bf
Nov 14 08:24:16 user nova-compute[75305]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23933646337653639
Nov 14 08:24:16 user nova-compute[75305]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f8ab888
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be32f689-616b-43bc-a524-055bbd50aa06]: (4, None) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d46db-66ee-46ac-ae10-89a24d363fef]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:24:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7907178-fcbc-4c51-a591-3db0530d14c1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260]
Nov 14 08:24:17 user nova-compute[75305]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68, portal: 172.16.0.220,3260] successful.
Nov 14 08:24:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0bd001b4-ad73-4c2a-8e0a-d273df7dbe68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb7a7b1-0279-43bb-b748-e9146e0c0671]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== disconnect_volume: return (365ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:24:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Deleting instance files /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5_del
Nov 14 08:24:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Deletion of /opt/stack/data/nova/instances/64b4867a-3fba-49db-b4c7-2a92bfa4d0a5_del complete
Nov 14 08:24:17 user nova-compute[75305]: INFO nova.compute.manager [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 14 08:24:17 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:17 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:24:17 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Took 0.72 seconds to deallocate network for instance.
Nov 14 08:24:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-91aa272a-8884-4c9e-b95e-3caff537e60c req-7b108ce1-cf36-4205-8b10-37a49190e5db service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-deleted-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-45a8cc5c-83ed-4182-8cb5-b74cda253865 req-82778015-1013-49b3-8d12-bd3368db1a20 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-45a8cc5c-83ed-4182-8cb5-b74cda253865 req-82778015-1013-49b3-8d12-bd3368db1a20 service nova] Acquiring lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-45a8cc5c-83ed-4182-8cb5-b74cda253865 req-82778015-1013-49b3-8d12-bd3368db1a20 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-45a8cc5c-83ed-4182-8cb5-b74cda253865 req-82778015-1013-49b3-8d12-bd3368db1a20 service nova] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-45a8cc5c-83ed-4182-8cb5-b74cda253865 req-82778015-1013-49b3-8d12-bd3368db1a20 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] No waiting events found dispatching network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:24:18 user nova-compute[75305]: WARNING nova.compute.manager [req-45a8cc5c-83ed-4182-8cb5-b74cda253865 req-82778015-1013-49b3-8d12-bd3368db1a20 service nova] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Received unexpected event network-vif-plugged-22af325a-a511-4313-a09e-4d0804a62b0b for instance with vm_state active and task_state deleting.
Nov 14 08:24:18 user nova-compute[75305]: INFO nova.compute.manager [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5] Took 0.85 seconds to detach 1 volumes for instance.
Nov 14 08:24:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:24:18 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:24:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:19 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Deleted allocations for instance 64b4867a-3fba-49db-b4c7-2a92bfa4d0a5
Nov 14 08:24:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-faf58048-9e10-4adf-9c61-a6e268d8350c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "64b4867a-3fba-49db-b4c7-2a92bfa4d0a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-changed-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Refreshing instance network info cache due to event network-changed-9e489d79-373d-49d1-aead-bf240bc0fe3c. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] Acquiring lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] Acquired lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG nova.network.neutron [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Refreshing network info cache for port 9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:23 user nova-compute[75305]: INFO nova.compute.manager [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Terminating instance
Nov 14 08:24:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updated VIF entry in instance network info cache for port 9e489d79-373d-49d1-aead-bf240bc0fe3c. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updating instance_info_cache with network_info: [{"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e147b965-6e80-4b20-bd0b-c5ffa3535f36 req-dfe3367b-8399-462c-96e2-e628eb68ed80 service nova] Releasing lock "refresh_cache-5b229490-ec43-495b-88f4-b829dd71c07b" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:24:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Instance destroyed successfully.
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lazy-loading 'resources' on Instance uuid 5b229490-ec43-495b-88f4-b829dd71c07b {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:17:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-552197203',display_name='tempest-TestStampPattern-server-552197203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-552197203',id=34,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDECpqXZ39yJhKNBdtHyasJhkEpTXP1jf3ZW+cfIJ2zbLVCmgEy5+PFQBkFXCyo6idt7/qq9uAbj+UgLZkJ9h0TNVNbnRQfF91Cg5e9J2qAT5cWwGnjSjvl8hUs4n/TyWg==',key_name='tempest-TestStampPattern-1143433304',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:17:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='38b3c6c530ef4c20b176189616d71c56',ramdisk_id='',reservation_id='r-uftn57vv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1608752450',owner_user_name='tempest-TestStampPattern-1608752450-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:20:34Z,user_data=None,user_id='b0b561dad6d74acfa63122951faf8f37',uuid=5b229490-ec43-495b-88f4-b829dd71c07b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converting VIF {"id": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "address": "fa:16:3e:96:43:df", "network": {"id": "11eece00-6686-4f91-aa77-7af002213408", "bridge": "br-int", "label": "tempest-TestStampPattern-1080058347-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "38b3c6c530ef4c20b176189616d71c56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e489d79-37", "ovs_interfaceid": "9e489d79-373d-49d1-aead-bf240bc0fe3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:43:df,bridge_name='br-int',has_traffic_filtering=True,id=9e489d79-373d-49d1-aead-bf240bc0fe3c,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e489d79-37') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG os_vif [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:43:df,bridge_name='br-int',has_traffic_filtering=True,id=9e489d79-373d-49d1-aead-bf240bc0fe3c,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e489d79-37') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e489d79-37, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c5fcc87-8850-499a-a73c-d45367441035) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:24:24 user nova-compute[75305]: INFO os_vif [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:43:df,bridge_name='br-int',has_traffic_filtering=True,id=9e489d79-373d-49d1-aead-bf240bc0fe3c,network=Network(11eece00-6686-4f91-aa77-7af002213408),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e489d79-37')
Nov 14 08:24:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Deleting instance files /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b_del
Nov 14 08:24:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Deletion of /opt/stack/data/nova/instances/5b229490-ec43-495b-88f4-b829dd71c07b_del complete
Nov 14 08:24:24 user nova-compute[75305]: INFO nova.compute.manager [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 08:24:24 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:24:24 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:24:25 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Took 0.62 seconds to deallocate network for instance.
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-904fdb96-3fc9-4206-ab51-cbf9d3f09540 req-f461125b-63f8-4d65-9249-4d37fff90eb6 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-vif-deleted-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:25 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Deleted allocations for instance 5b229490-ec43-495b-88f4-b829dd71c07b
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7ee63515-dc42-4cac-8fa7-64762f0bcd3c tempest-TestStampPattern-1608752450 tempest-TestStampPattern-1608752450-project-member] Lock "5b229490-ec43-495b-88f4-b829dd71c07b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.904s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-vif-unplugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] No waiting events found dispatching network-vif-unplugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:24:25 user nova-compute[75305]: WARNING nova.compute.manager [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received unexpected event network-vif-unplugged-9e489d79-373d-49d1-aead-bf240bc0fe3c for instance with vm_state deleted and task_state None.
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received event network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] Acquiring lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] Lock "5b229490-ec43-495b-88f4-b829dd71c07b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] No waiting events found dispatching network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:24:25 user nova-compute[75305]: WARNING nova.compute.manager [req-313a89ef-69c4-4ee2-b0c2-0020ade4655f req-f2c059b5-1ad4-4b9a-bc05-35010fea0159 service nova] [instance: 5b229490-ec43-495b-88f4-b829dd71c07b] Received unexpected event network-vif-plugged-9e489d79-373d-49d1-aead-bf240bc0fe3c for instance with vm_state deleted and task_state None.
Nov 14 08:24:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:28 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:24:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:24:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8621MB free_disk=24.872711181640625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance a05477af-47a7-4ceb-a214-59f70d731c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:24:31 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:24:32 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:24:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:24:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:24:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:24:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:24:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:24:59 user nova-compute[75305]: INFO nova.compute.claims [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Claim successful on node user
Nov 14 08:24:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:24:59 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:24:59 user nova-compute[75305]: INFO nova.virt.block_device [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Booting with volume 6914c93b-dfee-4456-8fca-ca0167a6f908 at /dev/vda
Nov 14 08:24:59 user nova-compute[75305]: DEBUG nova.policy [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1aa7ff0836d24d11ba27accb25936704', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b48539b5fa2a466bbaa3dbb207c45166', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG os_brick.utils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85484b6-159f-4064-9c87-955132fa3f07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ba893-6827-4503-b079-c96a054d1a8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:24:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.195s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f331a1ad-11f5-4eca-b2c8-29e0bc2cc5e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea9d26-e8cf-42ea-b43a-571f8b6d4b53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:25:00 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:25:00 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f61e0a-a476-4cba-b4c4-7b74337f3366]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG os_brick.utils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] <== get_connector_properties: return (306ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating existing volume attachment record: cb59ba64-6ace-4eff-821c-ee35f7d12107 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:25:00 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Successfully created port: 6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Successfully updated port: 6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing instance network info cache due to event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance network_info: |[{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updated VIF entry in instance network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:25:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0d63f315-c1c7-4cc6-8832-535469379908 req-c95ad0f2-40d3-4b7c-bf17-3a00d4c807de service nova] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:25:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:25:04 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Creating image(s)
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Ensure instance console log exists: /opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Start _get_guest_xml network_info=[{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'cb59ba64-6ace-4eff-821c-ee35f7d12107', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a9ba834-e5b3-4001-b511-5810aab0a445', 'attached_at': '', 'detached_at': '', 'volume_id': '6914c93b-dfee-4456-8fca-ca0167a6f908', 'serial': '6914c93b-dfee-4456-8fca-ca0167a6f908'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:25:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:25:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:25:04 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:25:04 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:25:04 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:25:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8469066c-c2bb-48d7-86c8-ce36d204a8c9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:25:04 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e7580d-0621-4720-808a-7a0fa173520f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908] added
Nov 14 08:25:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea21976-025c-47e7-bba2-ee958e070327]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae05cd3-b6cb-4c69-a9d4-2d81771955c5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjkQgShO {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjkQgShO" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faf43bb-3740-421c-a2ca-2bcb5ca44e4b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjkQgShO'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[de637c68-fa36-4e56-96eb-02a88d7531e9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e20a40-cd23-40bd-b4af-5e5443a568f4]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[911ffcb7-775a-4d32-9c92-6bde05a5d67c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]
Nov 14 08:25:04 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.
Nov 14 08:25:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc70e48-f8eb-4811-ad53-6903b72b8394]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2f08e0-b840-4f0a-87a7-a35aaaa9353b]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:25:04 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576d5a7-36eb-4666-ad17-a0362064fa70]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:04 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23266393333626638', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266393333626638', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2076355257',display_name='tempest-TestShelveInstance-server-2076355257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2076355257',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4dp5LFDsgiCVzcuXv4/eVuUgVOq40EjG8sHG8ING0SdThQ6cNdoKkU38WN9fNJ/mgtMBjv35+pZqG23rPt6KhgKHpw1k6UltH/Ndfte3aAYwu76CMHswd6m7GLrPI9Ng==',key_name='tempest-TestShelveInstance-827370384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48539b5fa2a466bbaa3dbb207c45166',ramdisk_id='',reservation_id='r-nmfr5qsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-578054605',owner_user_name='tempest-TestShelveInstance-578054605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:25:00Z,user_data=None,user_id='1aa7ff0836d24d11ba27accb25936704',uuid=4a9ba834-e5b3-4001-b511-5810aab0a445,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converting VIF {"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:25:05 user nova-compute[75305]:   <uuid>4a9ba834-e5b3-4001-b511-5810aab0a445</uuid>
Nov 14 08:25:05 user nova-compute[75305]:   <name>instance-00000029</name>
Nov 14 08:25:05 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:25:05 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:25:05 user nova-compute[75305]:   <metadata>
Nov 14 08:25:05 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:25:05 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:25:05 user nova-compute[75305]:       <nova:name>tempest-TestShelveInstance-server-2076355257</nova:name>
Nov 14 08:25:05 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:25:04</nova:creationTime>
Nov 14 08:25:05 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:25:05 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:25:05 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:25:05 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:25:05 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:25:05 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:25:05 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:25:05 user nova-compute[75305]:       <nova:owner>
Nov 14 08:25:05 user nova-compute[75305]:         <nova:user uuid="1aa7ff0836d24d11ba27accb25936704">tempest-TestShelveInstance-578054605-project-member</nova:user>
Nov 14 08:25:05 user nova-compute[75305]:         <nova:project uuid="b48539b5fa2a466bbaa3dbb207c45166">tempest-TestShelveInstance-578054605</nova:project>
Nov 14 08:25:05 user nova-compute[75305]:       </nova:owner>
Nov 14 08:25:05 user nova-compute[75305]:       <nova:ports>
Nov 14 08:25:05 user nova-compute[75305]:         <nova:port uuid="6f5c842e-5213-4a79-9c60-31af22c31952">
Nov 14 08:25:05 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:25:05 user nova-compute[75305]:         </nova:port>
Nov 14 08:25:05 user nova-compute[75305]:       </nova:ports>
Nov 14 08:25:05 user nova-compute[75305]:     </nova:instance>
Nov 14 08:25:05 user nova-compute[75305]:   </metadata>
Nov 14 08:25:05 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:25:05 user nova-compute[75305]:     <system>
Nov 14 08:25:05 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:25:05 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:25:05 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:25:05 user nova-compute[75305]:       <entry name="serial">4a9ba834-e5b3-4001-b511-5810aab0a445</entry>
Nov 14 08:25:05 user nova-compute[75305]:       <entry name="uuid">4a9ba834-e5b3-4001-b511-5810aab0a445</entry>
Nov 14 08:25:05 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:25:05 user nova-compute[75305]:     </system>
Nov 14 08:25:05 user nova-compute[75305]:   </sysinfo>
Nov 14 08:25:05 user nova-compute[75305]:   <os>
Nov 14 08:25:05 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:25:05 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:25:05 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:25:05 user nova-compute[75305]:   </os>
Nov 14 08:25:05 user nova-compute[75305]:   <features>
Nov 14 08:25:05 user nova-compute[75305]:     <acpi/>
Nov 14 08:25:05 user nova-compute[75305]:     <apic/>
Nov 14 08:25:05 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:25:05 user nova-compute[75305]:   </features>
Nov 14 08:25:05 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:25:05 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:25:05 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:25:05 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:25:05 user nova-compute[75305]:   </clock>
Nov 14 08:25:05 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:25:05 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:25:05 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:25:05 user nova-compute[75305]:   </cpu>
Nov 14 08:25:05 user nova-compute[75305]:   <devices>
Nov 14 08:25:05 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:25:05 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:25:05 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:25:05 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:25:05 user nova-compute[75305]:       <serial>6914c93b-dfee-4456-8fca-ca0167a6f908</serial>
Nov 14 08:25:05 user nova-compute[75305]:     </disk>
Nov 14 08:25:05 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:25:05 user nova-compute[75305]:       <mac address="fa:16:3e:e6:31:66"/>
Nov 14 08:25:05 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:25:05 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:25:05 user nova-compute[75305]:       <target dev="tap6f5c842e-52"/>
Nov 14 08:25:05 user nova-compute[75305]:     </interface>
Nov 14 08:25:05 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:25:05 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445/console.log" append="off"/>
Nov 14 08:25:05 user nova-compute[75305]:     </serial>
Nov 14 08:25:05 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:25:05 user nova-compute[75305]:     <video>
Nov 14 08:25:05 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:25:05 user nova-compute[75305]:     </video>
Nov 14 08:25:05 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:25:05 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:25:05 user nova-compute[75305]:     </rng>
Nov 14 08:25:05 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:25:05 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:25:05 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:25:05 user nova-compute[75305]:     </memballoon>
Nov 14 08:25:05 user nova-compute[75305]:   </devices>
Nov 14 08:25:05 user nova-compute[75305]: </domain>
Nov 14 08:25:05 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2076355257',display_name='tempest-TestShelveInstance-server-2076355257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2076355257',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4dp5LFDsgiCVzcuXv4/eVuUgVOq40EjG8sHG8ING0SdThQ6cNdoKkU38WN9fNJ/mgtMBjv35+pZqG23rPt6KhgKHpw1k6UltH/Ndfte3aAYwu76CMHswd6m7GLrPI9Ng==',key_name='tempest-TestShelveInstance-827370384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b48539b5fa2a466bbaa3dbb207c45166',ramdisk_id='',reservation_id='r-nmfr5qsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-578054605',owner_user_name='tempest-TestShelveInstance-578054605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:25:00Z,user_data=None,user_id='1aa7ff0836d24d11ba27accb25936704',uuid=4a9ba834-e5b3-4001-b511-5810aab0a445,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converting VIF {"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG os_vif [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '912f8ae0-4395-5a6c-8683-11404a0929fa', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f5c842e-52, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f5c842e-52, col_values=(('qos', UUID('cfe58bea-5209-45d7-b686-d038d9d95823')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f5c842e-52, col_values=(('external_ids', {'iface-id': '6f5c842e-5213-4a79-9c60-31af22c31952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:31:66', 'vm-uuid': '4a9ba834-e5b3-4001-b511-5810aab0a445'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:05 user nova-compute[75305]: INFO os_vif [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52')
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:25:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] No VIF found with MAC fa:16:3e:e6:31:66, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:25:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:06 user nova-compute[75305]: INFO nova.compute.manager [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Terminating instance
Nov 14 08:25:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:25:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-c1f53f62-6dab-4e13-a704-0c368abb0e4a req-7c5dba8f-1d55-4e9f-a2a5-734cac9372c7 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received event network-vif-unplugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c1f53f62-6dab-4e13-a704-0c368abb0e4a req-7c5dba8f-1d55-4e9f-a2a5-734cac9372c7 service nova] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c1f53f62-6dab-4e13-a704-0c368abb0e4a req-7c5dba8f-1d55-4e9f-a2a5-734cac9372c7 service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c1f53f62-6dab-4e13-a704-0c368abb0e4a req-7c5dba8f-1d55-4e9f-a2a5-734cac9372c7 service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-c1f53f62-6dab-4e13-a704-0c368abb0e4a req-7c5dba8f-1d55-4e9f-a2a5-734cac9372c7 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] No waiting events found dispatching network-vif-unplugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-c1f53f62-6dab-4e13-a704-0c368abb0e4a req-7c5dba8f-1d55-4e9f-a2a5-734cac9372c7 service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received event network-vif-unplugged-27a201cb-868c-4357-a4f1-f4b27046b4cf for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Instance destroyed successfully.
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'resources' on Instance uuid 36cc9bba-70f0-4bcd-bf54-81cfd335f797 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:15:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2063802549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2063802549',id=33,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:15:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-ohrpq3zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:17:41Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=36cc9bba-70f0-4bcd-bf54-81cfd335f797,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "address": "fa:16:3e:69:a6:86", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a201cb-86", "ovs_interfaceid": "27a201cb-868c-4357-a4f1-f4b27046b4cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:a6:86,bridge_name='br-int',has_traffic_filtering=True,id=27a201cb-868c-4357-a4f1-f4b27046b4cf,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a201cb-86') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG os_vif [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a6:86,bridge_name='br-int',has_traffic_filtering=True,id=27a201cb-868c-4357-a4f1-f4b27046b4cf,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a201cb-86') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27a201cb-86, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=926f2889-f7bf-4963-9f63-22b75e873c02) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:07 user nova-compute[75305]: INFO os_vif [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:a6:86,bridge_name='br-int',has_traffic_filtering=True,id=27a201cb-868c-4357-a4f1-f4b27046b4cf,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a201cb-86')
Nov 14 08:25:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Deleting instance files /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797_del
Nov 14 08:25:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Deletion of /opt/stack/data/nova/instances/36cc9bba-70f0-4bcd-bf54-81cfd335f797_del complete
Nov 14 08:25:07 user nova-compute[75305]: INFO nova.compute.manager [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 08:25:07 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:25:07 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:25:08 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:08 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Took 0.45 seconds to deallocate network for instance.
Nov 14 08:25:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:08 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:25:08 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:25:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:08 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Deleted allocations for instance 36cc9bba-70f0-4bcd-bf54-81cfd335f797
Nov 14 08:25:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2904aaf5-14c4-45a2-bd02-4f9b7900b961 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.042s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received event network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Acquiring lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Lock "36cc9bba-70f0-4bcd-bf54-81cfd335f797-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] No waiting events found dispatching network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:09 user nova-compute[75305]: WARNING nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received unexpected event network-vif-plugged-27a201cb-868c-4357-a4f1-f4b27046b4cf for instance with vm_state deleted and task_state None.
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:09 user nova-compute[75305]: WARNING nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received unexpected event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with vm_state building and task_state spawning.
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:09 user nova-compute[75305]: WARNING nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received unexpected event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with vm_state building and task_state spawning.
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-b1421f7a-c4b6-484a-9e64-b72e799b5177 req-7707f126-ce66-4fac-8ff6-2226c4f143da service nova] [instance: 36cc9bba-70f0-4bcd-bf54-81cfd335f797] Received event network-vif-deleted-27a201cb-868c-4357-a4f1-f4b27046b4cf {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:25:09 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance spawned successfully.
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:25:09 user nova-compute[75305]: INFO nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 08:25:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:25:09 user nova-compute[75305]: INFO nova.compute.manager [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Took 10.53 seconds to build instance.
Nov 14 08:25:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e718832a-ded1-47de-b833-22e6a4cd8b6a tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.617s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:25:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:30 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:25:31 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8558MB free_disk=24.993671417236328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance f5e23822-868e-4437-b87b-487179175d6c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance a05477af-47a7-4ceb-a214-59f70d731c99 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 4a9ba834-e5b3-4001-b511-5810aab0a445 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:25:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "a05477af-47a7-4ceb-a214-59f70d731c99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "a05477af-47a7-4ceb-a214-59f70d731c99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:33 user nova-compute[75305]: INFO nova.compute.manager [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Terminating instance
Nov 14 08:25:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-2bbe2ddd-86f6-4bf5-a65b-7bd414d52d37 req-556c7205-8570-4b97-959f-fe45d67d672f service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received event network-vif-unplugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2bbe2ddd-86f6-4bf5-a65b-7bd414d52d37 req-556c7205-8570-4b97-959f-fe45d67d672f service nova] Acquiring lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2bbe2ddd-86f6-4bf5-a65b-7bd414d52d37 req-556c7205-8570-4b97-959f-fe45d67d672f service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2bbe2ddd-86f6-4bf5-a65b-7bd414d52d37 req-556c7205-8570-4b97-959f-fe45d67d672f service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-2bbe2ddd-86f6-4bf5-a65b-7bd414d52d37 req-556c7205-8570-4b97-959f-fe45d67d672f service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] No waiting events found dispatching network-vif-unplugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-2bbe2ddd-86f6-4bf5-a65b-7bd414d52d37 req-556c7205-8570-4b97-959f-fe45d67d672f service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received event network-vif-unplugged-5195f494-1a01-4620-9886-f528dc176be9 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:25:34 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Instance destroyed successfully.
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'resources' on Instance uuid a05477af-47a7-4ceb-a214-59f70d731c99 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:23:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-109733247',display_name='tempest-TestVolumeBootPattern-server-109733247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-109733247',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:24:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-k3baed4r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:24:01Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=a05477af-47a7-4ceb-a214-59f70d731c99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "5195f494-1a01-4620-9886-f528dc176be9", "address": "fa:16:3e:c5:0b:8a", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5195f494-1a", "ovs_interfaceid": "5195f494-1a01-4620-9886-f528dc176be9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0b:8a,bridge_name='br-int',has_traffic_filtering=True,id=5195f494-1a01-4620-9886-f528dc176be9,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5195f494-1a') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_vif [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0b:8a,bridge_name='br-int',has_traffic_filtering=True,id=5195f494-1a01-4620-9886-f528dc176be9,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5195f494-1a') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5195f494-1a, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cdb6a08c-0ad3-4e5d-b47d-ea83de39e155) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:34 user nova-compute[75305]: INFO os_vif [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:0b:8a,bridge_name='br-int',has_traffic_filtering=True,id=5195f494-1a01-4620-9886-f528dc176be9,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5195f494-1a')
Nov 14 08:25:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ikDyGaVC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:25:34 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8be1047-4c2f-4c28-8169-6d1733080692]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:25:34 user nova-compute[75305]: No targets found.
Nov 14 08:25:34 user nova-compute[75305]: iSNS:
Nov 14 08:25:34 user nova-compute[75305]: No targets found.
Nov 14 08:25:34 user nova-compute[75305]: STATIC:
Nov 14 08:25:34 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9
Nov 14 08:25:34 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:25:34 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:25:34 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908
Nov 14 08:25:34 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:25:34 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:25:34 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:25:34 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:25:34 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:25:34 user nova-compute[75305]: FIRMWARE:
Nov 14 08:25:34 user nova-compute[75305]: No targets found.
Nov 14 08:25:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:25:34 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:25:34 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad3031e-f531-47ce-bcac-ac94d0f5a133]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b54fd6e-8996-4da4-9a7f-fbc73662b34c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:34 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:25:34 user nova-compute[75305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:25:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:34 user nova-compute[75305]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 (non-flash)
Nov 14 08:25:34 user nova-compute[75305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:25:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542a9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc91bc65-0bc1-4019-bdbd-1c44f33550c1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc945dc-24d9-41ad-81d7-312db661d7cf]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05227314-8826-4bd0-a669-d399b52b8e25]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e9eb52-a947-44fc-9e2d-9b7e5e2d6c50]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23736383962613661', '/dev/disk/by-id/scsi-1SCST_BIOeb34cc87-7689ba6a12738ed7', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_eb34cc87') {{(pid=86224) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5730f462-bd14-496a-b3dc-e9e46c81d5ad]: (4, None) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cab9235-bcad-47f4-9c45-e56c08874f45]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5409755d-e6ff-494c-b09f-7adf82a9e6d5]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260]
Nov 14 08:25:35 user nova-compute[75305]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9, portal: 172.16.0.220,3260] successful.
Nov 14 08:25:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bc146c-5c67-45e9-98e0-c3f98ab92555]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== disconnect_volume: return (316ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:25:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Deleting instance files /opt/stack/data/nova/instances/a05477af-47a7-4ceb-a214-59f70d731c99_del
Nov 14 08:25:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Deletion of /opt/stack/data/nova/instances/a05477af-47a7-4ceb-a214-59f70d731c99_del complete
Nov 14 08:25:35 user nova-compute[75305]: INFO nova.compute.manager [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d60e5d0c-052d-410c-93ce-2753bb5555b7 req-1c9cb74b-4a19-4db3-939c-75eb380b85e6 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received event network-vif-deleted-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:35 user nova-compute[75305]: INFO nova.compute.manager [req-d60e5d0c-052d-410c-93ce-2753bb5555b7 req-1c9cb74b-4a19-4db3-939c-75eb380b85e6 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Neutron deleted interface 5195f494-1a01-4620-9886-f528dc176be9; detaching it from the instance and deleting it from the info cache
Nov 14 08:25:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-d60e5d0c-052d-410c-93ce-2753bb5555b7 req-1c9cb74b-4a19-4db3-939c-75eb380b85e6 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:35 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Took 0.59 seconds to deallocate network for instance.
Nov 14 08:25:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d60e5d0c-052d-410c-93ce-2753bb5555b7 req-1c9cb74b-4a19-4db3-939c-75eb380b85e6 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Detach interface failed, port_id=5195f494-1a01-4620-9886-f528dc176be9, reason: Instance a05477af-47a7-4ceb-a214-59f70d731c99 could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:25:36 user nova-compute[75305]: INFO nova.compute.manager [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 08:25:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Deleting volume: c7b4f24a-3f96-48cc-8c4d-f7c386e10eb9 {{(pid=75305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-fce71b47-da1d-4472-a528-414530f4d9f4 req-9f3d5df9-2b24-44d8-a1c3-5961b1580457 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received event network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fce71b47-da1d-4472-a528-414530f4d9f4 req-9f3d5df9-2b24-44d8-a1c3-5961b1580457 service nova] Acquiring lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fce71b47-da1d-4472-a528-414530f4d9f4 req-9f3d5df9-2b24-44d8-a1c3-5961b1580457 service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fce71b47-da1d-4472-a528-414530f4d9f4 req-9f3d5df9-2b24-44d8-a1c3-5961b1580457 service nova] Lock "a05477af-47a7-4ceb-a214-59f70d731c99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-fce71b47-da1d-4472-a528-414530f4d9f4 req-9f3d5df9-2b24-44d8-a1c3-5961b1580457 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] No waiting events found dispatching network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:36 user nova-compute[75305]: WARNING nova.compute.manager [req-fce71b47-da1d-4472-a528-414530f4d9f4 req-9f3d5df9-2b24-44d8-a1c3-5961b1580457 service nova] [instance: a05477af-47a7-4ceb-a214-59f70d731c99] Received unexpected event network-vif-plugged-5195f494-1a01-4620-9886-f528dc176be9 for instance with vm_state active and task_state deleting.
Nov 14 08:25:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:25:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.208s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:36 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Deleted allocations for instance a05477af-47a7-4ceb-a214-59f70d731c99
Nov 14 08:25:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-33ec0ff9-507d-46bc-83a2-bedec236e885 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "a05477af-47a7-4ceb-a214-59f70d731c99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.049s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid d16d469c-6caf-4ba0-869e-2eb0c4908d24 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updating instance_info_cache with network_info: [{"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-d16d469c-6caf-4ba0-869e-2eb0c4908d24" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:25:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:25:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:25:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:25:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:25:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "f5e23822-868e-4437-b87b-487179175d6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:57 user nova-compute[75305]: INFO nova.compute.manager [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Terminating instance
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-e1196da1-2cd7-4a19-8025-a204a917228c req-90ad06b5-2bea-49a5-af66-66d5ca8fd1d6 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e1196da1-2cd7-4a19-8025-a204a917228c req-90ad06b5-2bea-49a5-af66-66d5ca8fd1d6 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e1196da1-2cd7-4a19-8025-a204a917228c req-90ad06b5-2bea-49a5-af66-66d5ca8fd1d6 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e1196da1-2cd7-4a19-8025-a204a917228c req-90ad06b5-2bea-49a5-af66-66d5ca8fd1d6 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-e1196da1-2cd7-4a19-8025-a204a917228c req-90ad06b5-2bea-49a5-af66-66d5ca8fd1d6 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.compute.manager [req-e1196da1-2cd7-4a19-8025-a204a917228c req-90ad06b5-2bea-49a5-af66-66d5ca8fd1d6 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-unplugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Instance destroyed successfully.
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'resources' on Instance uuid f5e23822-868e-4437-b87b-487179175d6c {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1305131567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1305131567',id=24,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:12:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-d068ubjg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:13:57Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=f5e23822-868e-4437-b87b-487179175d6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "205f3177-c6be-4124-b32a-fe905fdb9493", "address": "fa:16:3e:38:2f:79", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap205f3177-c6", "ovs_interfaceid": "205f3177-c6be-4124-b32a-fe905fdb9493", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG os_vif [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap205f3177-c6, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c0582f8-c741-4f78-82e8-fdd1d6206f1e) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:25:57 user nova-compute[75305]: INFO os_vif [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:2f:79,bridge_name='br-int',has_traffic_filtering=True,id=205f3177-c6be-4124-b32a-fe905fdb9493,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap205f3177-c6')
Nov 14 08:25:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMNhyYjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:25:57 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:25:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a13b9f8-5d57-4a21-9216-56480d5f87cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:25:57 user nova-compute[75305]: No targets found.
Nov 14 08:25:57 user nova-compute[75305]: iSNS:
Nov 14 08:25:57 user nova-compute[75305]: No targets found.
Nov 14 08:25:57 user nova-compute[75305]: STATIC:
Nov 14 08:25:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908
Nov 14 08:25:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:25:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:25:57 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67
Nov 14 08:25:57 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:25:57 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:25:57 user nova-compute[75305]: FIRMWARE:
Nov 14 08:25:57 user nova-compute[75305]: No targets found.
Nov 14 08:25:57 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:25:57 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:25:57 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:25:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8852866-3f37-46a2-87c3-5397d41aec5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4349b2-e400-4e84-89ba-56521b34549c]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:58 user nova-compute[75305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:25:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 (non-flash)
Nov 14 08:25:58 user nova-compute[75305]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:25:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf20766c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67'): ({'sde'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Removing single pathed devices sde {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c80e4-54fa-43d3-94e3-a80ea33988ad]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d809933b-6b6b-4ace-a29a-fdc569e6a8ba]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Flushing IO for device /dev/sde {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18451f2b-1532-4991-a9a5-150603a34723]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3083f6-f1b3-4fc3-b342-4dc2ec146201]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca93b967-19dc-46cd-a5bd-8b87c98e3d46]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[737646cc-e976-42fd-91c2-56f30b7bea0f]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260]
Nov 14 08:25:58 user nova-compute[75305]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67, portal: 172.16.0.220,3260] successful.
Nov 14 08:25:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a6f6dd4-a311-4876-850d-dcebf1e15f67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7c709b-e1c5-4b91-bea1-63a980b00c52]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] <== disconnect_volume: return (314ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:25:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Deleting instance files /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c_del
Nov 14 08:25:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Deletion of /opt/stack/data/nova/instances/f5e23822-868e-4437-b87b-487179175d6c_del complete
Nov 14 08:25:58 user nova-compute[75305]: INFO nova.compute.manager [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 14 08:25:58 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:58 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: f5e23822-868e-4437-b87b-487179175d6c] Took 0.46 seconds to deallocate network for instance.
Nov 14 08:25:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-4cd73b89-b6fc-4472-a9b8-4aeae749a62e req-8db36cdc-ccfc-40f2-a30c-72c6a7ea26d9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-deleted-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:58 user nova-compute[75305]: INFO nova.compute.manager [req-4cd73b89-b6fc-4472-a9b8-4aeae749a62e req-8db36cdc-ccfc-40f2-a30c-72c6a7ea26d9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Neutron deleted interface 205f3177-c6be-4124-b32a-fe905fdb9493; detaching it from the instance and deleting it from the info cache
Nov 14 08:25:58 user nova-compute[75305]: DEBUG nova.network.neutron [req-4cd73b89-b6fc-4472-a9b8-4aeae749a62e req-8db36cdc-ccfc-40f2-a30c-72c6a7ea26d9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-4cd73b89-b6fc-4472-a9b8-4aeae749a62e req-8db36cdc-ccfc-40f2-a30c-72c6a7ea26d9 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Detach interface failed, port_id=205f3177-c6be-4124-b32a-fe905fdb9493, reason: Instance f5e23822-868e-4437-b87b-487179175d6c could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:25:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:25:59 user nova-compute[75305]: INFO nova.compute.manager [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: f5e23822-868e-4437-b87b-487179175d6c] Took 0.81 seconds to detach 1 volumes for instance.
Nov 14 08:25:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-c9caf9a1-1e12-40ed-a392-8206c05638c4 req-3f8ed166-4add-4a8e-9ea8-777b92baabc4 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c9caf9a1-1e12-40ed-a392-8206c05638c4 req-3f8ed166-4add-4a8e-9ea8-777b92baabc4 service nova] Acquiring lock "f5e23822-868e-4437-b87b-487179175d6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c9caf9a1-1e12-40ed-a392-8206c05638c4 req-3f8ed166-4add-4a8e-9ea8-777b92baabc4 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c9caf9a1-1e12-40ed-a392-8206c05638c4 req-3f8ed166-4add-4a8e-9ea8-777b92baabc4 service nova] Lock "f5e23822-868e-4437-b87b-487179175d6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG nova.compute.manager [req-c9caf9a1-1e12-40ed-a392-8206c05638c4 req-3f8ed166-4add-4a8e-9ea8-777b92baabc4 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] No waiting events found dispatching network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:25:59 user nova-compute[75305]: WARNING nova.compute.manager [req-c9caf9a1-1e12-40ed-a392-8206c05638c4 req-3f8ed166-4add-4a8e-9ea8-777b92baabc4 service nova] [instance: f5e23822-868e-4437-b87b-487179175d6c] Received unexpected event network-vif-plugged-205f3177-c6be-4124-b32a-fe905fdb9493 for instance with vm_state deleted and task_state None.
Nov 14 08:25:59 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:25:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:25:59 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Deleted allocations for instance f5e23822-868e-4437-b87b-487179175d6c
Nov 14 08:25:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-db28ceb7-c236-4f5a-88ef-793b443e1fe5 tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "f5e23822-868e-4437-b87b-487179175d6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.626s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:26:02 user nova-compute[75305]: INFO nova.compute.claims [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Claim successful on node user
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:26:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.policy [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21d44248f2c74b498c1e0f2fdb5ce3c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c82e1333b5b4e4d80dbbf4a8925a6b3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:26:02 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Creating image(s)
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "/opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "/opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.207s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk 1073741824" returned: 0 in 0.055s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Successfully created port: 71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Cannot resize image /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Ensure instance console log exists: /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Successfully updated port: 71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquired lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-changed-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Refreshing instance network info cache due to event network-changed-71f7eb4a-c7f7-4f81-86b3-9267b28881ab. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] Acquiring lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating instance_info_cache with network_info: [{"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Releasing lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Instance network_info: |[{"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] Acquired lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Refreshing network info cache for port 71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Start _get_guest_xml network_info=[{"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:26:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:26:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-995547992',display_name='tempest-SnapshotDataIntegrityTests-server-995547992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-995547992',id=42,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeRHiZOAvrNmIaQcTVo4MI6IdE55B6GvCQpEUhZPJWWiMC05BbLXM1UFugkks394fu6VcAXZGRIZ7svzq5pCj4Kmk+YQH/DXedWY67lPppFW9gIo23fJ3nG6zNDYmBQKw==',key_name='tempest-keypair-1870962507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c82e1333b5b4e4d80dbbf4a8925a6b3',ramdisk_id='',reservation_id='r-my2ko0th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-162218343',owner_user_name='tempest-SnapshotDataIntegrityTests-162218343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d44248f2c74b498c1e0f2fdb5ce3c2',uuid=5e9b6777-7e5c-4a9e-a077-deb7d0c9790f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Converting VIF {"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:3b:8a,bridge_name='br-int',has_traffic_filtering=True,id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab,network=Network(d3bd36d3-ba1c-402f-96a0-c6cad54a4861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f7eb4a-c7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:26:04 user nova-compute[75305]:   <uuid>5e9b6777-7e5c-4a9e-a077-deb7d0c9790f</uuid>
Nov 14 08:26:04 user nova-compute[75305]:   <name>instance-0000002a</name>
Nov 14 08:26:04 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:26:04 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:26:04 user nova-compute[75305]:   <metadata>
Nov 14 08:26:04 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:26:04 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:26:04 user nova-compute[75305]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-995547992</nova:name>
Nov 14 08:26:04 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:26:04</nova:creationTime>
Nov 14 08:26:04 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:26:04 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:26:04 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:26:04 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:26:04 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:26:04 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:26:04 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:26:04 user nova-compute[75305]:       <nova:owner>
Nov 14 08:26:04 user nova-compute[75305]:         <nova:user uuid="21d44248f2c74b498c1e0f2fdb5ce3c2">tempest-SnapshotDataIntegrityTests-162218343-project-member</nova:user>
Nov 14 08:26:04 user nova-compute[75305]:         <nova:project uuid="2c82e1333b5b4e4d80dbbf4a8925a6b3">tempest-SnapshotDataIntegrityTests-162218343</nova:project>
Nov 14 08:26:04 user nova-compute[75305]:       </nova:owner>
Nov 14 08:26:04 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:26:04 user nova-compute[75305]:       <nova:ports>
Nov 14 08:26:04 user nova-compute[75305]:         <nova:port uuid="71f7eb4a-c7f7-4f81-86b3-9267b28881ab">
Nov 14 08:26:04 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 08:26:04 user nova-compute[75305]:         </nova:port>
Nov 14 08:26:04 user nova-compute[75305]:       </nova:ports>
Nov 14 08:26:04 user nova-compute[75305]:     </nova:instance>
Nov 14 08:26:04 user nova-compute[75305]:   </metadata>
Nov 14 08:26:04 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:26:04 user nova-compute[75305]:     <system>
Nov 14 08:26:04 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:26:04 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:26:04 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:26:04 user nova-compute[75305]:       <entry name="serial">5e9b6777-7e5c-4a9e-a077-deb7d0c9790f</entry>
Nov 14 08:26:04 user nova-compute[75305]:       <entry name="uuid">5e9b6777-7e5c-4a9e-a077-deb7d0c9790f</entry>
Nov 14 08:26:04 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:26:04 user nova-compute[75305]:     </system>
Nov 14 08:26:04 user nova-compute[75305]:   </sysinfo>
Nov 14 08:26:04 user nova-compute[75305]:   <os>
Nov 14 08:26:04 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:26:04 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:26:04 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:26:04 user nova-compute[75305]:   </os>
Nov 14 08:26:04 user nova-compute[75305]:   <features>
Nov 14 08:26:04 user nova-compute[75305]:     <acpi/>
Nov 14 08:26:04 user nova-compute[75305]:     <apic/>
Nov 14 08:26:04 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:26:04 user nova-compute[75305]:   </features>
Nov 14 08:26:04 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:26:04 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:26:04 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:26:04 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:26:04 user nova-compute[75305]:   </clock>
Nov 14 08:26:04 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:26:04 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:26:04 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:26:04 user nova-compute[75305]:   </cpu>
Nov 14 08:26:04 user nova-compute[75305]:   <devices>
Nov 14 08:26:04 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:26:04 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:26:04 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk"/>
Nov 14 08:26:04 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:26:04 user nova-compute[75305]:     </disk>
Nov 14 08:26:04 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:26:04 user nova-compute[75305]:       <mac address="fa:16:3e:66:3b:8a"/>
Nov 14 08:26:04 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:26:04 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:26:04 user nova-compute[75305]:       <target dev="tap71f7eb4a-c7"/>
Nov 14 08:26:04 user nova-compute[75305]:     </interface>
Nov 14 08:26:04 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:26:04 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/console.log" append="off"/>
Nov 14 08:26:04 user nova-compute[75305]:     </serial>
Nov 14 08:26:04 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:26:04 user nova-compute[75305]:     <video>
Nov 14 08:26:04 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:26:04 user nova-compute[75305]:     </video>
Nov 14 08:26:04 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:26:04 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:26:04 user nova-compute[75305]:     </rng>
Nov 14 08:26:04 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:26:04 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:26:04 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:26:04 user nova-compute[75305]:     </memballoon>
Nov 14 08:26:04 user nova-compute[75305]:   </devices>
Nov 14 08:26:04 user nova-compute[75305]: </domain>
Nov 14 08:26:04 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-995547992',display_name='tempest-SnapshotDataIntegrityTests-server-995547992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-995547992',id=42,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeRHiZOAvrNmIaQcTVo4MI6IdE55B6GvCQpEUhZPJWWiMC05BbLXM1UFugkks394fu6VcAXZGRIZ7svzq5pCj4Kmk+YQH/DXedWY67lPppFW9gIo23fJ3nG6zNDYmBQKw==',key_name='tempest-keypair-1870962507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2c82e1333b5b4e4d80dbbf4a8925a6b3',ramdisk_id='',reservation_id='r-my2ko0th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-162218343',owner_user_name='tempest-SnapshotDataIntegrityTests-162218343-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:26:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d44248f2c74b498c1e0f2fdb5ce3c2',uuid=5e9b6777-7e5c-4a9e-a077-deb7d0c9790f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Converting VIF {"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:3b:8a,bridge_name='br-int',has_traffic_filtering=True,id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab,network=Network(d3bd36d3-ba1c-402f-96a0-c6cad54a4861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f7eb4a-c7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG os_vif [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:3b:8a,bridge_name='br-int',has_traffic_filtering=True,id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab,network=Network(d3bd36d3-ba1c-402f-96a0-c6cad54a4861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f7eb4a-c7') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cece3a7-b855-510e-9505-a0768edcc207', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71f7eb4a-c7, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71f7eb4a-c7, col_values=(('qos', UUID('f5d007d1-b649-4b00-8971-19cc54af9fa2')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71f7eb4a-c7, col_values=(('external_ids', {'iface-id': '71f7eb4a-c7f7-4f81-86b3-9267b28881ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:3b:8a', 'vm-uuid': '5e9b6777-7e5c-4a9e-a077-deb7d0c9790f'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:04 user nova-compute[75305]: INFO os_vif [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:3b:8a,bridge_name='br-int',has_traffic_filtering=True,id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab,network=Network(d3bd36d3-ba1c-402f-96a0-c6cad54a4861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f7eb4a-c7')
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No VIF found with MAC fa:16:3e:66:3b:8a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updated VIF entry in instance network info cache for port 71f7eb4a-c7f7-4f81-86b3-9267b28881ab. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG nova.network.neutron [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating instance_info_cache with network_info: [{"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-238ca4dd-1c76-4f62-8713-12438b297c6d req-8969c3df-1abb-4c39-9d62-3a1de173ed6f service nova] Releasing lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-7daf73a6-6c7d-411b-af2f-942c5475cbe8 req-038b6ad3-322d-49d5-8bf5-9590deb2320a service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7daf73a6-6c7d-411b-af2f-942c5475cbe8 req-038b6ad3-322d-49d5-8bf5-9590deb2320a service nova] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7daf73a6-6c7d-411b-af2f-942c5475cbe8 req-038b6ad3-322d-49d5-8bf5-9590deb2320a service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-7daf73a6-6c7d-411b-af2f-942c5475cbe8 req-038b6ad3-322d-49d5-8bf5-9590deb2320a service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-7daf73a6-6c7d-411b-af2f-942c5475cbe8 req-038b6ad3-322d-49d5-8bf5-9590deb2320a service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] No waiting events found dispatching network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:05 user nova-compute[75305]: WARNING nova.compute.manager [req-7daf73a6-6c7d-411b-af2f-942c5475cbe8 req-038b6ad3-322d-49d5-8bf5-9590deb2320a service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received unexpected event network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab for instance with vm_state building and task_state spawning.
Nov 14 08:26:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:26:07 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Instance spawned successfully.
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:07 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3ba8150-fd18-49e2-b41c-45916c83bf70 req-444e3e24-55ac-4446-9144-3bd696be51a4 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3ba8150-fd18-49e2-b41c-45916c83bf70 req-444e3e24-55ac-4446-9144-3bd696be51a4 service nova] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3ba8150-fd18-49e2-b41c-45916c83bf70 req-444e3e24-55ac-4446-9144-3bd696be51a4 service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3ba8150-fd18-49e2-b41c-45916c83bf70 req-444e3e24-55ac-4446-9144-3bd696be51a4 service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:08 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3ba8150-fd18-49e2-b41c-45916c83bf70 req-444e3e24-55ac-4446-9144-3bd696be51a4 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] No waiting events found dispatching network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:08 user nova-compute[75305]: WARNING nova.compute.manager [req-b3ba8150-fd18-49e2-b41c-45916c83bf70 req-444e3e24-55ac-4446-9144-3bd696be51a4 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received unexpected event network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab for instance with vm_state building and task_state spawning.
Nov 14 08:26:08 user nova-compute[75305]: INFO nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 14 08:26:08 user nova-compute[75305]: DEBUG nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:26:08 user nova-compute[75305]: INFO nova.compute.manager [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Took 5.70 seconds to build instance.
Nov 14 08:26:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c005ede4-112d-403f-ac5d-ace9b85a4b6b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.797s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:26:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:32 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:26:32 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=24.954254150390625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance d16d469c-6caf-4ba0-869e-2eb0c4908d24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 4a9ba834-e5b3-4001-b511-5810aab0a445 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:26:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:26:33 user nova-compute[75305]: INFO nova.compute.claims [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Claim successful on node user
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:26:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.policy [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347d5cb8a22e49948b1c210d2d62ce2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a5b13c6fbb417184c70151551cd2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:26:33 user nova-compute[75305]: INFO nova.virt.block_device [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Booting with volume c4a04280-6f6f-4b3f-8578-d8279b02762c at /dev/vda
Nov 14 08:26:33 user nova-compute[75305]: DEBUG os_brick.utils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa7713b-2f67-450b-890c-ca1b8312fc05]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[157cd6be-ec6a-4add-9c6e-505c1c107248]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204756d-9700-4032-8375-8203a90008fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ba6d19-f45e-4629-86f2-987849bfeaaa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:26:33 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:26:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89517f67-3851-4ac8-9626-901a89e84986]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG os_brick.utils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updating existing volume attachment record: 8ac89eee-3d4d-4bfe-b51d-a288dc4c39a9 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:26:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:34 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Successfully created port: 77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:26:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Successfully updated port: 77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquired lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-changed-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Refreshing instance network info cache due to event network-changed-77e36f2f-52de-4735-8c82-a937cecaa405. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] Acquiring lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updating instance_info_cache with network_info: [{"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Releasing lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Instance network_info: |[{"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] Acquired lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Refreshing network info cache for port 77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updated VIF entry in instance network info cache for port 77e36f2f-52de-4735-8c82-a937cecaa405. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updating instance_info_cache with network_info: [{"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9d5fec27-5694-4793-b104-51ab804ca294 req-494b147d-0b55-4d3d-b106-e599b5ac19f6 service nova] Releasing lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:26:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Creating image(s)
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Ensure instance console log exists: /opt/stack/data/nova/instances/fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Start _get_guest_xml network_info=[{"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '8ac89eee-3d4d-4bfe-b51d-a288dc4c39a9', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPIVRWZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4a04280-6f6f-4b3f-8578-d8279b02762c', 'serial': 'c4a04280-6f6f-4b3f-8578-d8279b02762c'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:26:38 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:26:38 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPIVRWZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:26:38 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:26:38 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:26:38 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67eb270-7402-44b8-a11e-56838a076b65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:26:38 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[36023298-0273-4c5f-9795-32133d9a8b0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c] added
Nov 14 08:26:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f30f48c-1575-4147-981a-10416edda4d4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fc341c-5b1b-467e-a41d-63114073eb90]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPIVRWZt {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FPIVRWZt" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cf9beb-fed2-46ac-a8ad-1652cea6ca0d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FPIVRWZt'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b967e44e-1366-4d9e-9772-761476f155bb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e14d8c4-c871-409b-94b7-ab4f03de7330]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:26:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:26:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8bac2-332e-4cd4-b5c7-4c35a77338f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260]
Nov 14 08:26:38 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260] successful.
Nov 14 08:26:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac963e6-ebfc-4587-9d28-f904bc0b402a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0ebada-6107-406b-a2fe-8d9c5a3b6057]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:26:38 user nova-compute[75305]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:26:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:26:38 user nova-compute[75305]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:26:38 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db9e475-47d4-4890-aefa-2250d85473da]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPIVRWZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:26:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26262383665653939', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262383665653939', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-689832123',display_name='tempest-TestVolumeBootPattern-volume-backed-server-689832123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-689832123',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeGJifp1NS/syXsZQD7PWvQybXVA4lGimCX1eG4lqstdeVMq9qwBuYc7uGbG60wuLaK711qORN0L9MZuUrZTh67VG9tISLWYv4K3JQwaFodwWfGw5wlFff5KvTxqpPgFQ==',key_name='tempest-keypair-1849401724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-9cx0y15e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:26:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:20:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e36f2f-52de-4735-8c82-a937cecaa405,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e36f2f-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'pci_devices' on Instance uuid fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:26:39 user nova-compute[75305]:   <uuid>fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d</uuid>
Nov 14 08:26:39 user nova-compute[75305]:   <name>instance-0000002b</name>
Nov 14 08:26:39 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:26:39 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:26:39 user nova-compute[75305]:   <metadata>
Nov 14 08:26:39 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:26:39 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:26:39 user nova-compute[75305]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-689832123</nova:name>
Nov 14 08:26:39 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:26:38</nova:creationTime>
Nov 14 08:26:39 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:26:39 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:26:39 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:26:39 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:26:39 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:26:39 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:26:39 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:26:39 user nova-compute[75305]:       <nova:owner>
Nov 14 08:26:39 user nova-compute[75305]:         <nova:user uuid="347d5cb8a22e49948b1c210d2d62ce2b">tempest-TestVolumeBootPattern-1297430060-project-member</nova:user>
Nov 14 08:26:39 user nova-compute[75305]:         <nova:project uuid="37a5b13c6fbb417184c70151551cd2a4">tempest-TestVolumeBootPattern-1297430060</nova:project>
Nov 14 08:26:39 user nova-compute[75305]:       </nova:owner>
Nov 14 08:26:39 user nova-compute[75305]:       <nova:ports>
Nov 14 08:26:39 user nova-compute[75305]:         <nova:port uuid="77e36f2f-52de-4735-8c82-a937cecaa405">
Nov 14 08:26:39 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 08:26:39 user nova-compute[75305]:         </nova:port>
Nov 14 08:26:39 user nova-compute[75305]:       </nova:ports>
Nov 14 08:26:39 user nova-compute[75305]:     </nova:instance>
Nov 14 08:26:39 user nova-compute[75305]:   </metadata>
Nov 14 08:26:39 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:26:39 user nova-compute[75305]:     <system>
Nov 14 08:26:39 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:26:39 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:26:39 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:26:39 user nova-compute[75305]:       <entry name="serial">fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d</entry>
Nov 14 08:26:39 user nova-compute[75305]:       <entry name="uuid">fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d</entry>
Nov 14 08:26:39 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:26:39 user nova-compute[75305]:     </system>
Nov 14 08:26:39 user nova-compute[75305]:   </sysinfo>
Nov 14 08:26:39 user nova-compute[75305]:   <os>
Nov 14 08:26:39 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:26:39 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:26:39 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:26:39 user nova-compute[75305]:   </os>
Nov 14 08:26:39 user nova-compute[75305]:   <features>
Nov 14 08:26:39 user nova-compute[75305]:     <acpi/>
Nov 14 08:26:39 user nova-compute[75305]:     <apic/>
Nov 14 08:26:39 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:26:39 user nova-compute[75305]:   </features>
Nov 14 08:26:39 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:26:39 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:26:39 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:26:39 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:26:39 user nova-compute[75305]:   </clock>
Nov 14 08:26:39 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:26:39 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:26:39 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:26:39 user nova-compute[75305]:   </cpu>
Nov 14 08:26:39 user nova-compute[75305]:   <devices>
Nov 14 08:26:39 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:26:39 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:26:39 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:26:39 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:26:39 user nova-compute[75305]:       <serial>c4a04280-6f6f-4b3f-8578-d8279b02762c</serial>
Nov 14 08:26:39 user nova-compute[75305]:     </disk>
Nov 14 08:26:39 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:26:39 user nova-compute[75305]:       <mac address="fa:16:3e:47:20:aa"/>
Nov 14 08:26:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:26:39 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:26:39 user nova-compute[75305]:       <target dev="tap77e36f2f-52"/>
Nov 14 08:26:39 user nova-compute[75305]:     </interface>
Nov 14 08:26:39 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:26:39 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d/console.log" append="off"/>
Nov 14 08:26:39 user nova-compute[75305]:     </serial>
Nov 14 08:26:39 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:26:39 user nova-compute[75305]:     <video>
Nov 14 08:26:39 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:26:39 user nova-compute[75305]:     </video>
Nov 14 08:26:39 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:26:39 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:26:39 user nova-compute[75305]:     </rng>
Nov 14 08:26:39 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:26:39 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:26:39 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:26:39 user nova-compute[75305]:     </memballoon>
Nov 14 08:26:39 user nova-compute[75305]:   </devices>
Nov 14 08:26:39 user nova-compute[75305]: </domain>
Nov 14 08:26:39 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-689832123',display_name='tempest-TestVolumeBootPattern-volume-backed-server-689832123',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-689832123',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeGJifp1NS/syXsZQD7PWvQybXVA4lGimCX1eG4lqstdeVMq9qwBuYc7uGbG60wuLaK711qORN0L9MZuUrZTh67VG9tISLWYv4K3JQwaFodwWfGw5wlFff5KvTxqpPgFQ==',key_name='tempest-keypair-1849401724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-9cx0y15e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:26:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:20:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e36f2f-52de-4735-8c82-a937cecaa405,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e36f2f-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG os_vif [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:20:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e36f2f-52de-4735-8c82-a937cecaa405,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e36f2f-52') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '453f6dbb-e4db-5062-b5ee-c1c0d114acc8', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77e36f2f-52, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77e36f2f-52, col_values=(('qos', UUID('2aaefb6c-d88e-47a7-9b69-be3d0415b9c6')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77e36f2f-52, col_values=(('external_ids', {'iface-id': '77e36f2f-52de-4735-8c82-a937cecaa405', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:20:aa', 'vm-uuid': 'fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:39 user nova-compute[75305]: INFO os_vif [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:20:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e36f2f-52de-4735-8c82-a937cecaa405,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e36f2f-52')
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:26:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No VIF found with MAC fa:16:3e:47:20:aa, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:26:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-ada855df-94ab-459f-9892-883ebca515f1 req-52c68872-1c26-495c-b787-5edccf759952 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ada855df-94ab-459f-9892-883ebca515f1 req-52c68872-1c26-495c-b787-5edccf759952 service nova] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ada855df-94ab-459f-9892-883ebca515f1 req-52c68872-1c26-495c-b787-5edccf759952 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ada855df-94ab-459f-9892-883ebca515f1 req-52c68872-1c26-495c-b787-5edccf759952 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-ada855df-94ab-459f-9892-883ebca515f1 req-52c68872-1c26-495c-b787-5edccf759952 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] No waiting events found dispatching network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:41 user nova-compute[75305]: WARNING nova.compute.manager [req-ada855df-94ab-459f-9892-883ebca515f1 req-52c68872-1c26-495c-b787-5edccf759952 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received unexpected event network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 for instance with vm_state building and task_state spawning.
Nov 14 08:26:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:26:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Instance spawned successfully.
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:26:43 user nova-compute[75305]: INFO nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-b33a0742-3e51-4101-a72a-a603f044a5a2 req-742d3b4a-6297-4991-9c6f-5a189b0e4867 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b33a0742-3e51-4101-a72a-a603f044a5a2 req-742d3b4a-6297-4991-9c6f-5a189b0e4867 service nova] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b33a0742-3e51-4101-a72a-a603f044a5a2 req-742d3b4a-6297-4991-9c6f-5a189b0e4867 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b33a0742-3e51-4101-a72a-a603f044a5a2 req-742d3b4a-6297-4991-9c6f-5a189b0e4867 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-b33a0742-3e51-4101-a72a-a603f044a5a2 req-742d3b4a-6297-4991-9c6f-5a189b0e4867 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] No waiting events found dispatching network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:43 user nova-compute[75305]: WARNING nova.compute.manager [req-b33a0742-3e51-4101-a72a-a603f044a5a2 req-742d3b4a-6297-4991-9c6f-5a189b0e4867 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received unexpected event network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 for instance with vm_state building and task_state spawning.
Nov 14 08:26:43 user nova-compute[75305]: INFO nova.compute.manager [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Took 9.95 seconds to build instance.
Nov 14 08:26:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4dfff496-cc39-4c02-9a3f-19d278c00d5e tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.038s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:48 user nova-compute[75305]: INFO nova.compute.manager [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Terminating instance
Nov 14 08:26:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-fad37524-b69b-424b-b62a-e2d1284a7ee1 req-78c5b019-e8b4-4ceb-849a-45af8d6154fa service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received event network-vif-unplugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fad37524-b69b-424b-b62a-e2d1284a7ee1 req-78c5b019-e8b4-4ceb-849a-45af8d6154fa service nova] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fad37524-b69b-424b-b62a-e2d1284a7ee1 req-78c5b019-e8b4-4ceb-849a-45af8d6154fa service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fad37524-b69b-424b-b62a-e2d1284a7ee1 req-78c5b019-e8b4-4ceb-849a-45af8d6154fa service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-fad37524-b69b-424b-b62a-e2d1284a7ee1 req-78c5b019-e8b4-4ceb-849a-45af8d6154fa service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] No waiting events found dispatching network-vif-unplugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-fad37524-b69b-424b-b62a-e2d1284a7ee1 req-78c5b019-e8b4-4ceb-849a-45af8d6154fa service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received event network-vif-unplugged-8e036b50-5d50-45a4-a21f-205fb17beb6f for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:26:49 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Instance destroyed successfully.
Nov 14 08:26:49 user nova-compute[75305]: DEBUG nova.objects.instance [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lazy-loading 'resources' on Instance uuid d16d469c-6caf-4ba0-869e-2eb0c4908d24 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:07:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-572658733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-572658733',id=21,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:07:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f92869b8c2e246ca8f9d361c8ecabac0',ramdisk_id='',reservation_id='r-ork7weqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-983718269',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:09:08Z,user_data=None,user_id='74b6bdb955524015ad1aec74ee466957',uuid=d16d469c-6caf-4ba0-869e-2eb0c4908d24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converting VIF {"id": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "address": "fa:16:3e:7e:7e:5b", "network": {"id": "25ebdeea-0ce2-4103-9355-2b3639f7ecaf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1684893292-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f92869b8c2e246ca8f9d361c8ecabac0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e036b50-5d", "ovs_interfaceid": "8e036b50-5d50-45a4-a21f-205fb17beb6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:7e:5b,bridge_name='br-int',has_traffic_filtering=True,id=8e036b50-5d50-45a4-a21f-205fb17beb6f,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e036b50-5d') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG os_vif [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:7e:5b,bridge_name='br-int',has_traffic_filtering=True,id=8e036b50-5d50-45a4-a21f-205fb17beb6f,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e036b50-5d') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e036b50-5d, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9937718-333f-4b8a-b506-5677fbcd0276) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:49 user nova-compute[75305]: INFO os_vif [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:7e:5b,bridge_name='br-int',has_traffic_filtering=True,id=8e036b50-5d50-45a4-a21f-205fb17beb6f,network=Network(25ebdeea-0ce2-4103-9355-2b3639f7ecaf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e036b50-5d')
Nov 14 08:26:49 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Deleting instance files /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24_del
Nov 14 08:26:49 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Deletion of /opt/stack/data/nova/instances/d16d469c-6caf-4ba0-869e-2eb0c4908d24_del complete
Nov 14 08:26:49 user nova-compute[75305]: INFO nova.compute.manager [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 08:26:49 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:49 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Took 0.54 seconds to deallocate network for instance.
Nov 14 08:26:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:50 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Deleted allocations for instance d16d469c-6caf-4ba0-869e-2eb0c4908d24
Nov 14 08:26:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-19597105-da65-4c80-83de-0209e154411c tempest-ServerBootFromVolumeStableRescueTest-983718269 tempest-ServerBootFromVolumeStableRescueTest-983718269-project-member] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.801s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-620e274d-49fa-43f8-bfe5-29bbc9307e73 req-9e2d5118-0097-4252-bfcc-37a5c1b4c195 service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received event network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-620e274d-49fa-43f8-bfe5-29bbc9307e73 req-9e2d5118-0097-4252-bfcc-37a5c1b4c195 service nova] Acquiring lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-620e274d-49fa-43f8-bfe5-29bbc9307e73 req-9e2d5118-0097-4252-bfcc-37a5c1b4c195 service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-620e274d-49fa-43f8-bfe5-29bbc9307e73 req-9e2d5118-0097-4252-bfcc-37a5c1b4c195 service nova] Lock "d16d469c-6caf-4ba0-869e-2eb0c4908d24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-620e274d-49fa-43f8-bfe5-29bbc9307e73 req-9e2d5118-0097-4252-bfcc-37a5c1b4c195 service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] No waiting events found dispatching network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:50 user nova-compute[75305]: WARNING nova.compute.manager [req-620e274d-49fa-43f8-bfe5-29bbc9307e73 req-9e2d5118-0097-4252-bfcc-37a5c1b4c195 service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received unexpected event network-vif-plugged-8e036b50-5d50-45a4-a21f-205fb17beb6f for instance with vm_state deleted and task_state None.
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-620e274d-49fa-43f8-bfe5-29bbc9307e73 req-9e2d5118-0097-4252-bfcc-37a5c1b4c195 service nova] [instance: d16d469c-6caf-4ba0-869e-2eb0c4908d24] Received event network-vif-deleted-8e036b50-5d50-45a4-a21f-205fb17beb6f {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.compute.manager [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing instance network info cache due to event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:50 user nova-compute[75305]: DEBUG nova.network.neutron [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG nova.network.neutron [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updated VIF entry in instance network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG nova.network.neutron [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-06a21d40-737c-4446-9ce5-ca4f7e8d06cf req-cd63908f-3897-4fb3-ac78-10af9bd3611b service nova] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:51 user nova-compute[75305]: INFO nova.compute.manager [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Shelve offloading
Nov 14 08:26:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:52 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance destroyed successfully.
Nov 14 08:26:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-unplugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-unplugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:52 user nova-compute[75305]: WARNING nova.compute.manager [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received unexpected event network-vif-unplugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with vm_state active and task_state shelving.
Nov 14 08:26:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:26:52 user nova-compute[75305]: WARNING nova.compute.manager [req-9c836e97-6e7f-49a9-b1e5-fa870290c3da req-b9bccc76-ac02-4ac1-bbfd-ab6c988ec272 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received unexpected event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with vm_state active and task_state shelving.
Nov 14 08:26:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance destroyed successfully.
Nov 14 08:26:53 user nova-compute[75305]: DEBUG nova.objects.instance [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'resources' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2076355257',display_name='tempest-TestShelveInstance-server-2076355257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2076355257',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4dp5LFDsgiCVzcuXv4/eVuUgVOq40EjG8sHG8ING0SdThQ6cNdoKkU38WN9fNJ/mgtMBjv35+pZqG23rPt6KhgKHpw1k6UltH/Ndfte3aAYwu76CMHswd6m7GLrPI9Ng==',key_name='tempest-TestShelveInstance-827370384',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48539b5fa2a466bbaa3dbb207c45166',ramdisk_id='',reservation_id='r-nmfr5qsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-578054605',owner_user_name='tempest-TestShelveInstance-578054605-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:25:10Z,user_data=None,user_id='1aa7ff0836d24d11ba27accb25936704',uuid=4a9ba834-e5b3-4001-b511-5810aab0a445,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converting VIF {"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_vif [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f5c842e-52, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfe58bea-5209-45d7-b686-d038d9d95823) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:26:53 user nova-compute[75305]: INFO os_vif [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52')
Nov 14 08:26:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:26:53 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee35d73-83f0-458d-ae62-bd19f043e994]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:26:53 user nova-compute[75305]: No targets found.
Nov 14 08:26:53 user nova-compute[75305]: iSNS:
Nov 14 08:26:53 user nova-compute[75305]: No targets found.
Nov 14 08:26:53 user nova-compute[75305]: STATIC:
Nov 14 08:26:53 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908
Nov 14 08:26:53 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:26:53 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:26:53 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c
Nov 14 08:26:53 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:26:53 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:26:53 user nova-compute[75305]: FIRMWARE:
Nov 14 08:26:53 user nova-compute[75305]: No targets found.
Nov 14 08:26:53 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:26:53 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:26:53 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.050s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f33318-0f93-47f7-952f-0c4e2994a1b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e10338-8361-4d27-9891-63825cefdee1]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:26:53 user nova-compute[75305]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:26:53 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:26:53 user nova-compute[75305]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:26:53 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4428ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce97c09-5755-48bb-b1d6-d85c5786868d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93010d81-340c-46c4-b250-a4c745bfd4b1]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e42cfa-9adb-4844-bf92-51674e198797]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4e1358-30ee-48ef-bbb1-012b14c8187d]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[433881d7-de20-4713-8f6e-a98609306167]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0903de8e-761b-46b0-98e7-dea14c562141]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]
Nov 14 08:26:53 user nova-compute[75305]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.
Nov 14 08:26:53 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ceffcd-2dfd-457e-b5ca-65b736ea3164]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] <== disconnect_volume: return (325ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:26:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:26:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Deleting instance files /opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445_del
Nov 14 08:26:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Deletion of /opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445_del complete
Nov 14 08:26:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:26:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing instance network info cache due to event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:26:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:26:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:26:54 user nova-compute[75305]: DEBUG nova.network.neutron [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:26:54 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Deleted allocations for instance 4a9ba834-e5b3-4001-b511-5810aab0a445
Nov 14 08:26:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:26:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:26:54 user nova-compute[75305]: DEBUG nova.objects.instance [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG nova.objects.base [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Object Instance<4a9ba834-e5b3-4001-b511-5810aab0a445> lazy-loaded attributes: resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-88c5166f-249f-4809-ac2b-c030f5f8cd31 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.694s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG nova.network.neutron [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updated VIF entry in instance network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG nova.network.neutron [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": null, "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6f5c842e-52", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:26:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ddfd04f3-0406-4f60-8880-b06b8c0c5225 req-8bac7b41-4929-4270-88c2-685558dc2671 service nova] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:26:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:26:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:27:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:27:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:27:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:27:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:27 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:27:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:27:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8745MB free_disk=25.077167510986328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:27:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating instance_info_cache with network_info: [{"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:27:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:27:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "41effa45-fafa-4575-9f95-f0c43849929a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:27:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:27:49 user nova-compute[75305]: INFO nova.compute.claims [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Claim successful on node user
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:27:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:27:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Creating image(s)
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.policy [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9bee7b3e5f0483d94a46fbed06604c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369e5af19a940d69cec15ce79234459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:27:50 user nova-compute[75305]: INFO nova.compute.claims [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Claim successful on node user
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk 1073741824" returned: 0 in 0.059s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:27:50 user nova-compute[75305]: DEBUG nova.network.neutron [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:27:50 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.policy [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9bee7b3e5f0483d94a46fbed06604c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369e5af19a940d69cec15ce79234459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:27:51 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Creating image(s)
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Successfully created port: 08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Cannot resize image /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Ensure instance console log exists: /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.206s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk 1073741824" returned: 0 in 0.070s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.network.neutron [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Successfully created port: ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.203s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Successfully updated port: 08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-changed-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Refreshing instance network info cache due to event network-changed-08a6385a-27d3-47f4-99b9-0c13142d2a9b. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:27:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Cannot resize image /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Ensure instance console log exists: /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Successfully updated port: ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance network_info: |[{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Refreshing network info cache for port 08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Start _get_guest_xml network_info=[{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:27:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:27:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-changed-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Refreshing instance network info cache due to event network-changed-ccff71eb-24e0-428d-9e54-7c309615fe14. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] Acquiring lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1192194542',display_name='tempest-ServerRescueNegativeTestJSON-server-1192194542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1192194542',id=44,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-stjl4hgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:27:50Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=41effa45-fafa-4575-9f95-f0c43849929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.objects.instance [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'pci_devices' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:27:52 user nova-compute[75305]:   <uuid>41effa45-fafa-4575-9f95-f0c43849929a</uuid>
Nov 14 08:27:52 user nova-compute[75305]:   <name>instance-0000002c</name>
Nov 14 08:27:52 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:27:52 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:27:52 user nova-compute[75305]:   <metadata>
Nov 14 08:27:52 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:27:52 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1192194542</nova:name>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:27:52</nova:creationTime>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:27:52 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:27:52 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:owner>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:user uuid="d9bee7b3e5f0483d94a46fbed06604c5">tempest-ServerRescueNegativeTestJSON-300947473-project-member</nova:user>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:project uuid="7369e5af19a940d69cec15ce79234459">tempest-ServerRescueNegativeTestJSON-300947473</nova:project>
Nov 14 08:27:52 user nova-compute[75305]:       </nova:owner>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:ports>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:port uuid="08a6385a-27d3-47f4-99b9-0c13142d2a9b">
Nov 14 08:27:52 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:27:52 user nova-compute[75305]:         </nova:port>
Nov 14 08:27:52 user nova-compute[75305]:       </nova:ports>
Nov 14 08:27:52 user nova-compute[75305]:     </nova:instance>
Nov 14 08:27:52 user nova-compute[75305]:   </metadata>
Nov 14 08:27:52 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:27:52 user nova-compute[75305]:     <system>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="serial">41effa45-fafa-4575-9f95-f0c43849929a</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="uuid">41effa45-fafa-4575-9f95-f0c43849929a</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:27:52 user nova-compute[75305]:     </system>
Nov 14 08:27:52 user nova-compute[75305]:   </sysinfo>
Nov 14 08:27:52 user nova-compute[75305]:   <os>
Nov 14 08:27:52 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:27:52 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:27:52 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:27:52 user nova-compute[75305]:   </os>
Nov 14 08:27:52 user nova-compute[75305]:   <features>
Nov 14 08:27:52 user nova-compute[75305]:     <acpi/>
Nov 14 08:27:52 user nova-compute[75305]:     <apic/>
Nov 14 08:27:52 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:27:52 user nova-compute[75305]:   </features>
Nov 14 08:27:52 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:27:52 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:27:52 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:27:52 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:27:52 user nova-compute[75305]:   </clock>
Nov 14 08:27:52 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:27:52 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:27:52 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:27:52 user nova-compute[75305]:   </cpu>
Nov 14 08:27:52 user nova-compute[75305]:   <devices>
Nov 14 08:27:52 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:27:52 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:27:52 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk"/>
Nov 14 08:27:52 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:27:52 user nova-compute[75305]:     </disk>
Nov 14 08:27:52 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:27:52 user nova-compute[75305]:       <mac address="fa:16:3e:cd:9e:d1"/>
Nov 14 08:27:52 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:27:52 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:27:52 user nova-compute[75305]:       <target dev="tap08a6385a-27"/>
Nov 14 08:27:52 user nova-compute[75305]:     </interface>
Nov 14 08:27:52 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:27:52 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/console.log" append="off"/>
Nov 14 08:27:52 user nova-compute[75305]:     </serial>
Nov 14 08:27:52 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:27:52 user nova-compute[75305]:     <video>
Nov 14 08:27:52 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:27:52 user nova-compute[75305]:     </video>
Nov 14 08:27:52 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:27:52 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:27:52 user nova-compute[75305]:     </rng>
Nov 14 08:27:52 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:27:52 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:27:52 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:27:52 user nova-compute[75305]:     </memballoon>
Nov 14 08:27:52 user nova-compute[75305]:   </devices>
Nov 14 08:27:52 user nova-compute[75305]: </domain>
Nov 14 08:27:52 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1192194542',display_name='tempest-ServerRescueNegativeTestJSON-server-1192194542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1192194542',id=44,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-stjl4hgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:27:50Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=41effa45-fafa-4575-9f95-f0c43849929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG os_vif [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b0520d9-b54b-5451-88b3-6b6237b04c10', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08a6385a-27, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08a6385a-27, col_values=(('qos', UUID('7aa12207-dd33-4aa5-9814-038d1dcb395f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08a6385a-27, col_values=(('external_ids', {'iface-id': '08a6385a-27d3-47f4-99b9-0c13142d2a9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:9e:d1', 'vm-uuid': '41effa45-fafa-4575-9f95-f0c43849929a'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: INFO os_vif [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27')
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No VIF found with MAC fa:16:3e:cd:9e:d1, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance network_info: |[{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] Acquired lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Refreshing network info cache for port ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Start _get_guest_xml network_info=[{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:27:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:27:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319231213',display_name='tempest-ServerRescueNegativeTestJSON-server-1319231213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319231213',id=45,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-qozz58e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:27:51Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=fbf25e85-e17d-4b6b-8a48-40a6009bf129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.objects.instance [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'pci_devices' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updated VIF entry in instance network info cache for port 08a6385a-27d3-47f4-99b9-0c13142d2a9b. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.neutron [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:27:52 user nova-compute[75305]:   <uuid>fbf25e85-e17d-4b6b-8a48-40a6009bf129</uuid>
Nov 14 08:27:52 user nova-compute[75305]:   <name>instance-0000002d</name>
Nov 14 08:27:52 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:27:52 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:27:52 user nova-compute[75305]:   <metadata>
Nov 14 08:27:52 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:27:52 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1319231213</nova:name>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:27:52</nova:creationTime>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:27:52 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:27:52 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:owner>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:user uuid="d9bee7b3e5f0483d94a46fbed06604c5">tempest-ServerRescueNegativeTestJSON-300947473-project-member</nova:user>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:project uuid="7369e5af19a940d69cec15ce79234459">tempest-ServerRescueNegativeTestJSON-300947473</nova:project>
Nov 14 08:27:52 user nova-compute[75305]:       </nova:owner>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:27:52 user nova-compute[75305]:       <nova:ports>
Nov 14 08:27:52 user nova-compute[75305]:         <nova:port uuid="ccff71eb-24e0-428d-9e54-7c309615fe14">
Nov 14 08:27:52 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 08:27:52 user nova-compute[75305]:         </nova:port>
Nov 14 08:27:52 user nova-compute[75305]:       </nova:ports>
Nov 14 08:27:52 user nova-compute[75305]:     </nova:instance>
Nov 14 08:27:52 user nova-compute[75305]:   </metadata>
Nov 14 08:27:52 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:27:52 user nova-compute[75305]:     <system>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="serial">fbf25e85-e17d-4b6b-8a48-40a6009bf129</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="uuid">fbf25e85-e17d-4b6b-8a48-40a6009bf129</entry>
Nov 14 08:27:52 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:27:52 user nova-compute[75305]:     </system>
Nov 14 08:27:52 user nova-compute[75305]:   </sysinfo>
Nov 14 08:27:52 user nova-compute[75305]:   <os>
Nov 14 08:27:52 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:27:52 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:27:52 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:27:52 user nova-compute[75305]:   </os>
Nov 14 08:27:52 user nova-compute[75305]:   <features>
Nov 14 08:27:52 user nova-compute[75305]:     <acpi/>
Nov 14 08:27:52 user nova-compute[75305]:     <apic/>
Nov 14 08:27:52 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:27:52 user nova-compute[75305]:   </features>
Nov 14 08:27:52 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:27:52 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:27:52 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:27:52 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:27:52 user nova-compute[75305]:   </clock>
Nov 14 08:27:52 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:27:52 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:27:52 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:27:52 user nova-compute[75305]:   </cpu>
Nov 14 08:27:52 user nova-compute[75305]:   <devices>
Nov 14 08:27:52 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:27:52 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:27:52 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk"/>
Nov 14 08:27:52 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:27:52 user nova-compute[75305]:     </disk>
Nov 14 08:27:52 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:27:52 user nova-compute[75305]:       <mac address="fa:16:3e:72:de:b0"/>
Nov 14 08:27:52 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:27:52 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:27:52 user nova-compute[75305]:       <target dev="tapccff71eb-24"/>
Nov 14 08:27:52 user nova-compute[75305]:     </interface>
Nov 14 08:27:52 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:27:52 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/console.log" append="off"/>
Nov 14 08:27:52 user nova-compute[75305]:     </serial>
Nov 14 08:27:52 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:27:52 user nova-compute[75305]:     <video>
Nov 14 08:27:52 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:27:52 user nova-compute[75305]:     </video>
Nov 14 08:27:52 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:27:52 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:27:52 user nova-compute[75305]:     </rng>
Nov 14 08:27:52 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:27:52 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:27:52 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:27:52 user nova-compute[75305]:     </memballoon>
Nov 14 08:27:52 user nova-compute[75305]:   </devices>
Nov 14 08:27:52 user nova-compute[75305]: </domain>
Nov 14 08:27:52 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319231213',display_name='tempest-ServerRescueNegativeTestJSON-server-1319231213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319231213',id=45,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-qozz58e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:27:51Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=fbf25e85-e17d-4b6b-8a48-40a6009bf129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG os_vif [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb622ceb-faf3-511f-88ce-e6ccc546b9f4', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bda3aa43-f64a-4436-ba69-53030bd76d96 req-035b853e-8fc8-4ce8-be4e-e796a2eeb8f9 service nova] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccff71eb-24, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccff71eb-24, col_values=(('qos', UUID('ed5d65ab-b7b8-4644-975b-2ab88260a38f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccff71eb-24, col_values=(('external_ids', {'iface-id': 'ccff71eb-24e0-428d-9e54-7c309615fe14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:de:b0', 'vm-uuid': 'fbf25e85-e17d-4b6b-8a48-40a6009bf129'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:52 user nova-compute[75305]: INFO os_vif [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24')
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:27:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No VIF found with MAC fa:16:3e:72:de:b0, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updated VIF entry in instance network info cache for port ccff71eb-24e0-428d-9e54-7c309615fe14. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0021fb3b-2ad5-4e46-90c6-e50e686b0f72 req-cbe6a998-5751-414a-b24b-fbf20d80967d service nova] Releasing lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-changed-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Refreshing instance network info cache due to event network-changed-71f7eb4a-c7f7-4f81-86b3-9267b28881ab. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] Acquiring lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] Acquired lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Refreshing network info cache for port 71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updated VIF entry in instance network info cache for port 71f7eb4a-c7f7-4f81-86b3-9267b28881ab. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG nova.network.neutron [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating instance_info_cache with network_info: [{"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f03d0fef-48ac-49f6-a15d-a77452fbc706 req-9e3771eb-6e73-4d79-a7a4-dbbbcccf9be5 service nova] Releasing lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:27:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b7adaf9-185b-4114-8b3c-4ae5be8e9658 req-4b7e0d89-58d4-41b0-b8c1-a4aa50118837 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b7adaf9-185b-4114-8b3c-4ae5be8e9658 req-4b7e0d89-58d4-41b0-b8c1-a4aa50118837 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b7adaf9-185b-4114-8b3c-4ae5be8e9658 req-4b7e0d89-58d4-41b0-b8c1-a4aa50118837 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b7adaf9-185b-4114-8b3c-4ae5be8e9658 req-4b7e0d89-58d4-41b0-b8c1-a4aa50118837 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b7adaf9-185b-4114-8b3c-4ae5be8e9658 req-4b7e0d89-58d4-41b0-b8c1-a4aa50118837 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:27:54 user nova-compute[75305]: WARNING nova.compute.manager [req-5b7adaf9-185b-4114-8b3c-4ae5be8e9658 req-4b7e0d89-58d4-41b0-b8c1-a4aa50118837 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state building and task_state spawning.
Nov 14 08:27:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG nova.objects.instance [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:56 user nova-compute[75305]: INFO nova.compute.manager [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attaching volume 2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 to /dev/vdb
Nov 14 08:27:56 user nova-compute[75305]: DEBUG os_brick.utils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:27:56 user nova-compute[75305]: WARNING nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state building and task_state spawning.
Nov 14 08:27:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:27:56 user nova-compute[75305]: WARNING nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received unexpected event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with vm_state building and task_state spawning.
Nov 14 08:27:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:27:56 user nova-compute[75305]: WARNING nova.compute.manager [req-bbe3af04-5adf-4fd0-b9a9-6c4d8465d0cd req-a1230407-68ea-481a-a649-9c171c62ae17 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received unexpected event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with vm_state building and task_state spawning.
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19069e-181a-4de3-899b-b8260a17ca9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[94759494-8379-4d08-9598-99ab0fd521fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[93887cbf-b1a7-4182-9ae0-0bc15fe5fea9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:27:56 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae880e2-acf1-4209-ae4e-f1b7ea9ff59b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:27:57 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:27:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bda222-4580-4fa7-9345-f08eea16f640]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG os_brick.utils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating existing volume attachment record: 674f8ac3-01cb-485a-b6da-70416525c6e3 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:27:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance spawned successfully.
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: INFO nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Took 7.19 seconds to spawn the instance on the hypervisor.
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:27:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance spawned successfully.
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:27:57 user nova-compute[75305]: INFO nova.compute.manager [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Took 7.95 seconds to build instance.
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:27:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ce9b9eac-4423-4418-a7c9-f557fc0353d3 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "41effa45-fafa-4575-9f95-f0c43849929a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.041s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:57 user nova-compute[75305]: INFO nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 14 08:27:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:27:57 user nova-compute[75305]: INFO nova.compute.manager [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Took 7.40 seconds to build instance.
Nov 14 08:27:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-228ef247-e574-414d-8725-4f9f6544db88 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.508s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:27:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhUZDKan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:28:01 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:28:01 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:28:01 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85c47ad-3aa0-4cc5-9d0f-071b62d20dc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:28:01 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe48ff10-c2da-40c8-8b14-ca239ea8c365]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708] added
Nov 14 08:28:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0050325-855f-4033-b8f8-9fb0c72ee822]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ddbcf2-6acd-427f-8330-eeef1478ad3e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhUZDKan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NhUZDKan" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[21701e2d-aaa1-4879-a5b2-f8391f81328b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NhUZDKan'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6971e3e7-8b32-40f1-ba2f-0cfc7cd93aae]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77ade3d-b451-4e0b-abc7-60d6708d079e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a890acc5-c0bd-414f-ae4a-aa8a65d7c353]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260]
Nov 14 08:28:01 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260] successful.
Nov 14 08:28:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[074c8f90-355a-4e56-a77b-7646bcf64605]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8907171a-9169-4c3b-b782-c3b52f413af0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:01 user nova-compute[75305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 (non-flash)
Nov 14 08:28:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:01 user nova-compute[75305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 (non-flash)
Nov 14 08:28:01 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d53173a-ab64-4fc8-9be2-595ed910e96f]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:28:01 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhUZDKan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:28:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:28:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26637376338613766', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:28:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637376338613766', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:28:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:28:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:28:02 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:28:02 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:28:02 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:28:02 user nova-compute[75305]:   <serial>2a30f4b6-3b50-4d26-b8b5-e74aa72cb708</serial>
Nov 14 08:28:02 user nova-compute[75305]: </disk>
Nov 14 08:28:02 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:28:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:28:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:28:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No VIF found with MAC fa:16:3e:66:3b:8a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:28:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8c0438d5-4063-4a04-970b-b2cf11d9d94d tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.674s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:11 user nova-compute[75305]: INFO nova.compute.manager [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Detaching volume 2a30f4b6-3b50-4d26-b8b5-e74aa72cb708
Nov 14 08:28:11 user nova-compute[75305]: INFO nova.virt.block_device [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attempting to driver detach volume 2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 from mountpoint /dev/vdb
Nov 14 08:28:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Attempting to detach device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:28:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:28:11 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:28:11 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:28:11 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:28:11 user nova-compute[75305]:   <serial>2a30f4b6-3b50-4d26-b8b5-e74aa72cb708</serial>
Nov 14 08:28:11 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:28:11 user nova-compute[75305]: </disk>
Nov 14 08:28:11 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:28:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config.
Nov 14 08:28:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:28:11 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:28:11 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:28:11 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:28:11 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:28:11 user nova-compute[75305]:   <serial>2a30f4b6-3b50-4d26-b8b5-e74aa72cb708</serial>
Nov 14 08:28:11 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:28:11 user nova-compute[75305]: </disk>
Nov 14 08:28:11 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:28:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:28:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-changed-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Refreshing instance network info cache due to event network-changed-77e36f2f-52de-4735-8c82-a937cecaa405. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] Acquiring lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] Acquired lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Refreshing network info cache for port 77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updated VIF entry in instance network info cache for port 77e36f2f-52de-4735-8c82-a937cecaa405. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG nova.network.neutron [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updating instance_info_cache with network_info: [{"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:28:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0601183e-55b8-49ec-9fcc-afe05a2be7c6 req-5d1c50d0-058a-45ae-b5e0-37e7b800f7c4 service nova] Releasing lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:28:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:26 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:29 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:29 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:28:30 user nova-compute[75305]: INFO nova.compute.claims [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Claim successful on node user
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:28:30 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:28:30 user nova-compute[75305]: INFO nova.virt.block_device [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Booting with volume snapshot efbec10b-f777-4ca3-9dc7-d8e15f84e6de at /dev/vda
Nov 14 08:28:30 user nova-compute[75305]: DEBUG nova.policy [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347d5cb8a22e49948b1c210d2d62ce2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a5b13c6fbb417184c70151551cd2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:28:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:31 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Successfully created port: 2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:28:32 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f is timed out.
Nov 14 08:28:32 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config.
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Successfully updated port: 2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhUZDKan', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:28:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquired lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbd1aea-bc13-46ef-b0d7-234ae9e27301]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:28:32 user nova-compute[75305]: No targets found.
Nov 14 08:28:32 user nova-compute[75305]: iSNS:
Nov 14 08:28:32 user nova-compute[75305]: No targets found.
Nov 14 08:28:32 user nova-compute[75305]: STATIC:
Nov 14 08:28:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c
Nov 14 08:28:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:28:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:28:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708
Nov 14 08:28:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:28:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:28:32 user nova-compute[75305]: FIRMWARE:
Nov 14 08:28:32 user nova-compute[75305]: No targets found.
Nov 14 08:28:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:28:32 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:28:32 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b157780-c28b-4dd0-b298-22296a2a312c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea92f8-99d8-4909-960f-603b0466b3b0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:32 user nova-compute[75305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 (non-flash)
Nov 14 08:28:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:32 user nova-compute[75305]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 (non-flash)
Nov 14 08:28:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542abd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.compute.manager [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-changed-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.compute.manager [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Refreshing instance network info cache due to event network-changed-2158ae33-c737-4d7a-affe-47aefc41e73d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] Acquiring lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[046e28dc-5f99-434b-81d9-52d394fa4a7c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797f0fc-315e-453a-8f04-98b152726810]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[00747b6a-0d4e-4e23-b523-4bbd1917f3ea]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf0b43-ba6f-4d0f-b976-3ee5e8efce97]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a0e4e-2577-4cf0-91c0-f33deeac9b67]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0943132e-1815-4d1e-9789-1ad06b805997]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260]
Nov 14 08:28:32 user nova-compute[75305]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708, portal: 172.16.0.220,3260] successful.
Nov 14 08:28:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a30f4b6-3b50-4d26-b8b5-e74aa72cb708 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18bfa09-8fc4-4b25-861f-11d289f562ec]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== disconnect_volume: return (290ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Updating instance_info_cache with network_info: [{"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Releasing lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Instance network_info: |[{"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] Acquired lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.network.neutron [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Refreshing network info cache for port 2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.network.neutron [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Updated VIF entry in instance network info cache for port 2158ae33-c737-4d7a-affe-47aefc41e73d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:28:32 user nova-compute[75305]: DEBUG nova.network.neutron [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Updating instance_info_cache with network_info: [{"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f28a409e-fb68-451f-940e-b7177203c6ad req-06caf604-f70b-4187-87ba-26d47e1b58c7 service nova] Releasing lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-514e3d2f-e762-4db9-ad01-2fbb5b5ae02e tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.577s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:28:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8511MB free_disk=25.001258850097656GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 075d5e8d-af7e-4ce1-a0fd-1dededa3b783 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:28:34 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:28:35 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:28:35 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:28:35 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:28:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG os_brick.utils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[889f639f-51bd-4434-80e3-b2fa89e8d9cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1774291-c60c-4557-917a-91b7e8bf5e1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0408133-4d9d-46ff-9e39-3caad6b87cde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d762a2-cf42-4bb5-bd70-8c0c448ec4f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:28:36 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:28:36 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1351d1b1-8756-4ae8-a8de-e84bcce88248]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG os_brick.utils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:28:36 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Updating existing volume attachment record: 37d32c1b-205f-4993-96c4-d98bb34e62c0 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:28:37 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:37 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updating instance_info_cache with network_info: [{"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:28:39 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:28:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:28:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:28:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:28:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Creating image(s)
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Ensure instance console log exists: /opt/stack/data/nova/instances/075d5e8d-af7e-4ce1-a0fd-1dededa3b783/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Start _get_guest_xml network_info=[{"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T08:28:26Z,direct_url=<?>,disk_format='qcow2',id=ed45f1ac-199d-4ae5-ad11-8b6dcdb5b3ec,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1291950905',owner='37a5b13c6fbb417184c70151551cd2a4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T08:28:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '37d32c1b-205f-4993-96c4-d98bb34e62c0', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDwxHtKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '075d5e8d-af7e-4ce1-a0fd-1dededa3b783', 'attached_at': '', 'detached_at': '', 'volume_id': '3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7', 'serial': '3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:28:41 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:28:41 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T08:28:26Z,direct_url=<?>,disk_format='qcow2',id=ed45f1ac-199d-4ae5-ad11-8b6dcdb5b3ec,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1291950905',owner='37a5b13c6fbb417184c70151551cd2a4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T08:28:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDwxHtKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:28:41 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:28:41 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:28:41 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2960c152-f93d-4a09-ae5f-623dc234a963]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:28:41 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc57bd-b811-4db2-b5ec-f7aa9d0d775e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7] added
Nov 14 08:28:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec003e3c-560a-446c-a802-53d11fb9cc30]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c034d8b-25e0-4028-93ad-01966a11b495]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDwxHtKq {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CDwxHtKq" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3c0306-9387-4dbd-9bee-ef259adde2ed]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CDwxHtKq'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[824fc02c-aaa5-4731-b796-3ea2cd0de697]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7739d523-a2b0-4799-ad1f-88bcb7e0ea8a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c49d4de-4528-40ea-bd75-49b2130d5a8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260]
Nov 14 08:28:41 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260] successful.
Nov 14 08:28:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ad531-9538-4780-be6e-c6817c57cb64]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a76a03-ca3d-47b7-a650-a699c3979536]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:41 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:28:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:41 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:28:41 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[64686feb-3bb3-4eb8-90a6-efb00ba85b35]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:41 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDwxHtKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23636313230336235', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636313230336235', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1767828083',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1767828083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1767828083',id=46,image_ref='ed45f1ac-199d-4ae5-ad11-8b6dcdb5b3ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFmQqCyOIr8SZh/cKfY2NsNAca+e87nzHT/WsLxqPzE8ON7mve4Yt2BM3sAtUQUbZSGamLhNcVvF0dVh46gIXmRq8NFi+eT0OyKvV6BjGBrLp1YeZodehBF0hL2hMTQQw==',key_name='tempest-keypair-575202822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-75slmd0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1297430060',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=075d5e8d-af7e-4ce1-a0fd-1dededa3b783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:76:35,bridge_name='br-int',has_traffic_filtering=True,id=2158ae33-c737-4d7a-affe-47aefc41e73d,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2158ae33-c7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'pci_devices' on Instance uuid 075d5e8d-af7e-4ce1-a0fd-1dededa3b783 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:28:42 user nova-compute[75305]:   <uuid>075d5e8d-af7e-4ce1-a0fd-1dededa3b783</uuid>
Nov 14 08:28:42 user nova-compute[75305]:   <name>instance-0000002e</name>
Nov 14 08:28:42 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:28:42 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:28:42 user nova-compute[75305]:   <metadata>
Nov 14 08:28:42 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:28:42 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:28:42 user nova-compute[75305]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1767828083</nova:name>
Nov 14 08:28:42 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:28:41</nova:creationTime>
Nov 14 08:28:42 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:28:42 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:28:42 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:28:42 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:28:42 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:28:42 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:28:42 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:28:42 user nova-compute[75305]:       <nova:owner>
Nov 14 08:28:42 user nova-compute[75305]:         <nova:user uuid="347d5cb8a22e49948b1c210d2d62ce2b">tempest-TestVolumeBootPattern-1297430060-project-member</nova:user>
Nov 14 08:28:42 user nova-compute[75305]:         <nova:project uuid="37a5b13c6fbb417184c70151551cd2a4">tempest-TestVolumeBootPattern-1297430060</nova:project>
Nov 14 08:28:42 user nova-compute[75305]:       </nova:owner>
Nov 14 08:28:42 user nova-compute[75305]:       <nova:root type="image" uuid="ed45f1ac-199d-4ae5-ad11-8b6dcdb5b3ec"/>
Nov 14 08:28:42 user nova-compute[75305]:       <nova:ports>
Nov 14 08:28:42 user nova-compute[75305]:         <nova:port uuid="2158ae33-c737-4d7a-affe-47aefc41e73d">
Nov 14 08:28:42 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 08:28:42 user nova-compute[75305]:         </nova:port>
Nov 14 08:28:42 user nova-compute[75305]:       </nova:ports>
Nov 14 08:28:42 user nova-compute[75305]:     </nova:instance>
Nov 14 08:28:42 user nova-compute[75305]:   </metadata>
Nov 14 08:28:42 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:28:42 user nova-compute[75305]:     <system>
Nov 14 08:28:42 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:28:42 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:28:42 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:28:42 user nova-compute[75305]:       <entry name="serial">075d5e8d-af7e-4ce1-a0fd-1dededa3b783</entry>
Nov 14 08:28:42 user nova-compute[75305]:       <entry name="uuid">075d5e8d-af7e-4ce1-a0fd-1dededa3b783</entry>
Nov 14 08:28:42 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:28:42 user nova-compute[75305]:     </system>
Nov 14 08:28:42 user nova-compute[75305]:   </sysinfo>
Nov 14 08:28:42 user nova-compute[75305]:   <os>
Nov 14 08:28:42 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:28:42 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:28:42 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:28:42 user nova-compute[75305]:   </os>
Nov 14 08:28:42 user nova-compute[75305]:   <features>
Nov 14 08:28:42 user nova-compute[75305]:     <acpi/>
Nov 14 08:28:42 user nova-compute[75305]:     <apic/>
Nov 14 08:28:42 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:28:42 user nova-compute[75305]:   </features>
Nov 14 08:28:42 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:28:42 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:28:42 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:28:42 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:28:42 user nova-compute[75305]:   </clock>
Nov 14 08:28:42 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:28:42 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:28:42 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:28:42 user nova-compute[75305]:   </cpu>
Nov 14 08:28:42 user nova-compute[75305]:   <devices>
Nov 14 08:28:42 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:28:42 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:28:42 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:28:42 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:28:42 user nova-compute[75305]:       <serial>3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7</serial>
Nov 14 08:28:42 user nova-compute[75305]:     </disk>
Nov 14 08:28:42 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:28:42 user nova-compute[75305]:       <mac address="fa:16:3e:5f:76:35"/>
Nov 14 08:28:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:28:42 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:28:42 user nova-compute[75305]:       <target dev="tap2158ae33-c7"/>
Nov 14 08:28:42 user nova-compute[75305]:     </interface>
Nov 14 08:28:42 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:28:42 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/075d5e8d-af7e-4ce1-a0fd-1dededa3b783/console.log" append="off"/>
Nov 14 08:28:42 user nova-compute[75305]:     </serial>
Nov 14 08:28:42 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:28:42 user nova-compute[75305]:     <video>
Nov 14 08:28:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:28:42 user nova-compute[75305]:     </video>
Nov 14 08:28:42 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:28:42 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:28:42 user nova-compute[75305]:     </rng>
Nov 14 08:28:42 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:28:42 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:28:42 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:28:42 user nova-compute[75305]:     </memballoon>
Nov 14 08:28:42 user nova-compute[75305]:   </devices>
Nov 14 08:28:42 user nova-compute[75305]: </domain>
Nov 14 08:28:42 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1767828083',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1767828083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1767828083',id=46,image_ref='ed45f1ac-199d-4ae5-ad11-8b6dcdb5b3ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFmQqCyOIr8SZh/cKfY2NsNAca+e87nzHT/WsLxqPzE8ON7mve4Yt2BM3sAtUQUbZSGamLhNcVvF0dVh46gIXmRq8NFi+eT0OyKvV6BjGBrLp1YeZodehBF0hL2hMTQQw==',key_name='tempest-keypair-575202822',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-75slmd0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1297430060',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:28:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=075d5e8d-af7e-4ce1-a0fd-1dededa3b783,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:76:35,bridge_name='br-int',has_traffic_filtering=True,id=2158ae33-c737-4d7a-affe-47aefc41e73d,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2158ae33-c7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG os_vif [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:76:35,bridge_name='br-int',has_traffic_filtering=True,id=2158ae33-c737-4d7a-affe-47aefc41e73d,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2158ae33-c7') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f303d904-6e51-5574-ab8c-eff6ec8259fe', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2158ae33-c7, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2158ae33-c7, col_values=(('qos', UUID('9693e069-7587-485b-b858-1db7c17fe18f')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2158ae33-c7, col_values=(('external_ids', {'iface-id': '2158ae33-c737-4d7a-affe-47aefc41e73d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:76:35', 'vm-uuid': '075d5e8d-af7e-4ce1-a0fd-1dededa3b783'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:42 user nova-compute[75305]: INFO os_vif [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:76:35,bridge_name='br-int',has_traffic_filtering=True,id=2158ae33-c737-4d7a-affe-47aefc41e73d,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2158ae33-c7')
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:28:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No VIF found with MAC fa:16:3e:5f:76:35, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:43 user nova-compute[75305]: INFO nova.compute.manager [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Unshelving
Nov 14 08:28:43 user nova-compute[75305]: INFO nova.virt.block_device [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Booting with volume 6914c93b-dfee-4456-8fca-ca0167a6f908 at /dev/vda
Nov 14 08:28:43 user nova-compute[75305]: DEBUG os_brick.utils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe489bdb-2ae4-48d6-b47b-d045e541e19f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa85d69-a6e2-4f45-90f6-8c6e7ee15fb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbc298c-7ab1-4948-a9ca-66925e6f1543]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[43068f2b-3c6d-4e41-9fb2-c5f115de0b24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:28:43 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:28:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded987b1-bf2b-41c4-ab5b-12f4f18b52b4]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG os_brick.utils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:28:43 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating existing volume attachment record: 2914a351-b929-4bef-a4f3-9ec5e2de7915 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-e306e0fb-b345-4c35-911a-cd44f8a81890 req-a8b437b4-c4cb-4acd-af69-fb28f66513d3 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e306e0fb-b345-4c35-911a-cd44f8a81890 req-a8b437b4-c4cb-4acd-af69-fb28f66513d3 service nova] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e306e0fb-b345-4c35-911a-cd44f8a81890 req-a8b437b4-c4cb-4acd-af69-fb28f66513d3 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e306e0fb-b345-4c35-911a-cd44f8a81890 req-a8b437b4-c4cb-4acd-af69-fb28f66513d3 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-e306e0fb-b345-4c35-911a-cd44f8a81890 req-a8b437b4-c4cb-4acd-af69-fb28f66513d3 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] No waiting events found dispatching network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:28:44 user nova-compute[75305]: WARNING nova.compute.manager [req-e306e0fb-b345-4c35-911a-cd44f8a81890 req-a8b437b4-c4cb-4acd-af69-fb28f66513d3 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received unexpected event network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d for instance with vm_state building and task_state spawning.
Nov 14 08:28:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:28:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Instance spawned successfully.
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:28:46 user nova-compute[75305]: INFO nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-ea83aba3-43f6-483f-8d72-99589adb5465 req-461c3fcf-ff1c-4d42-bab5-d43d83772478 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ea83aba3-43f6-483f-8d72-99589adb5465 req-461c3fcf-ff1c-4d42-bab5-d43d83772478 service nova] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ea83aba3-43f6-483f-8d72-99589adb5465 req-461c3fcf-ff1c-4d42-bab5-d43d83772478 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ea83aba3-43f6-483f-8d72-99589adb5465 req-461c3fcf-ff1c-4d42-bab5-d43d83772478 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-ea83aba3-43f6-483f-8d72-99589adb5465 req-461c3fcf-ff1c-4d42-bab5-d43d83772478 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] No waiting events found dispatching network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:28:46 user nova-compute[75305]: WARNING nova.compute.manager [req-ea83aba3-43f6-483f-8d72-99589adb5465 req-461c3fcf-ff1c-4d42-bab5-d43d83772478 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received unexpected event network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d for instance with vm_state building and task_state spawning.
Nov 14 08:28:46 user nova-compute[75305]: INFO nova.compute.manager [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Took 16.19 seconds to build instance.
Nov 14 08:28:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cfc33f9b-6f28-4e84-b5f3-61c8903d3583 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.301s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:48 user nova-compute[75305]: DEBUG nova.objects.instance [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'pci_requests' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:28:48 user nova-compute[75305]: DEBUG nova.objects.instance [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'numa_topology' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:28:48 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:28:48 user nova-compute[75305]: INFO nova.compute.claims [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Claim successful on node user
Nov 14 08:28:48 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:28:48 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:28:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:48 user nova-compute[75305]: INFO nova.network.neutron [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating port 6f5c842e-5213-4a79-9c60-31af22c31952 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.network.neutron [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing instance network info cache due to event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.network.neutron [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:28:49 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Creating image(s)
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Ensure instance console log exists: /opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Start _get_guest_xml network_info=[{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '2914a351-b929-4bef-a4f3-9ec5e2de7915', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a9ba834-e5b3-4001-b511-5810aab0a445', 'attached_at': '', 'detached_at': '', 'volume_id': '6914c93b-dfee-4456-8fca-ca0167a6f908', 'serial': '6914c93b-dfee-4456-8fca-ca0167a6f908'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.network.neutron [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:28:49 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:28:49 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.objects.instance [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.objects.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Object Instance<4a9ba834-e5b3-4001-b511-5810aab0a445> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:28:49 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:28:49 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:28:49 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7aa79e-0a6d-4280-907c-9da696899617]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:28:49 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3c29a5-b08f-40ca-8316-bf23d8e3baab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908] added
Nov 14 08:28:49 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3031f2b0-b928-4c60-9d50-856a00574640]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3b1729-705e-438f-b35c-0623f33fad81]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjkQgShO {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mjkQgShO" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5b111b-0298-483e-839b-71905faef4b6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mjkQgShO'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[447a5910-4fae-4ab0-a6b5-d3472aa733b7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d649a-7d45-495a-b0b9-2f095e9406c1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:49 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:28:49 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:49 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:28:49 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa3d0a2-56fd-4fca-a895-1d691b07e31a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]
Nov 14 08:28:49 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.
Nov 14 08:28:49 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[46496057-d42f-47ab-866c-5e953875a130]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f9c425-66ea-441b-ac61-944ec61126a4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:50 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:28:50 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:28:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:28:50 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:28:50 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:28:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] HCTL ('35', '-', '-', 0) found on session 52 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ec311f-8e27-4bd3-a0f5-1ec3fa73b8b2]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Searching for a device in session 52 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG nova.network.neutron [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updated VIF entry in instance network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG nova.network.neutron [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:28:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-36d50a8e-1136-41aa-a6bd-d1bd0e090e0f req-245b132b-23ce-4790-b99e-91809129e8f7 service nova] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23266393333626638', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266393333626638', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2076355257',display_name='tempest-TestShelveInstance-server-2076355257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2076355257',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-827370384',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b48539b5fa2a466bbaa3dbb207c45166',ramdisk_id='',reservation_id='r-nmfr5qsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-578054605',owner_user_name='tempest-TestShelveInstance-578054605-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:28:43Z,user_data=None,user_id='1aa7ff0836d24d11ba27accb25936704',uuid=4a9ba834-e5b3-4001-b511-5810aab0a445,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converting VIF {"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.objects.instance [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.objects.base [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Object Instance<4a9ba834-e5b3-4001-b511-5810aab0a445> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:28:51 user nova-compute[75305]:   <uuid>4a9ba834-e5b3-4001-b511-5810aab0a445</uuid>
Nov 14 08:28:51 user nova-compute[75305]:   <name>instance-00000029</name>
Nov 14 08:28:51 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:28:51 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:28:51 user nova-compute[75305]:   <metadata>
Nov 14 08:28:51 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:28:51 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:28:51 user nova-compute[75305]:       <nova:name>tempest-TestShelveInstance-server-2076355257</nova:name>
Nov 14 08:28:51 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:28:49</nova:creationTime>
Nov 14 08:28:51 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:28:51 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:28:51 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:28:51 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:28:51 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:28:51 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:28:51 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:28:51 user nova-compute[75305]:       <nova:owner>
Nov 14 08:28:51 user nova-compute[75305]:         <nova:user uuid="1aa7ff0836d24d11ba27accb25936704">tempest-TestShelveInstance-578054605-project-member</nova:user>
Nov 14 08:28:51 user nova-compute[75305]:         <nova:project uuid="b48539b5fa2a466bbaa3dbb207c45166">tempest-TestShelveInstance-578054605</nova:project>
Nov 14 08:28:51 user nova-compute[75305]:       </nova:owner>
Nov 14 08:28:51 user nova-compute[75305]:       <nova:ports>
Nov 14 08:28:51 user nova-compute[75305]:         <nova:port uuid="6f5c842e-5213-4a79-9c60-31af22c31952">
Nov 14 08:28:51 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:28:51 user nova-compute[75305]:         </nova:port>
Nov 14 08:28:51 user nova-compute[75305]:       </nova:ports>
Nov 14 08:28:51 user nova-compute[75305]:     </nova:instance>
Nov 14 08:28:51 user nova-compute[75305]:   </metadata>
Nov 14 08:28:51 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:28:51 user nova-compute[75305]:     <system>
Nov 14 08:28:51 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:28:51 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:28:51 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:28:51 user nova-compute[75305]:       <entry name="serial">4a9ba834-e5b3-4001-b511-5810aab0a445</entry>
Nov 14 08:28:51 user nova-compute[75305]:       <entry name="uuid">4a9ba834-e5b3-4001-b511-5810aab0a445</entry>
Nov 14 08:28:51 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:28:51 user nova-compute[75305]:     </system>
Nov 14 08:28:51 user nova-compute[75305]:   </sysinfo>
Nov 14 08:28:51 user nova-compute[75305]:   <os>
Nov 14 08:28:51 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:28:51 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:28:51 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:28:51 user nova-compute[75305]:   </os>
Nov 14 08:28:51 user nova-compute[75305]:   <features>
Nov 14 08:28:51 user nova-compute[75305]:     <acpi/>
Nov 14 08:28:51 user nova-compute[75305]:     <apic/>
Nov 14 08:28:51 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:28:51 user nova-compute[75305]:   </features>
Nov 14 08:28:51 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:28:51 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:28:51 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:28:51 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:28:51 user nova-compute[75305]:   </clock>
Nov 14 08:28:51 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:28:51 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:28:51 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:28:51 user nova-compute[75305]:   </cpu>
Nov 14 08:28:51 user nova-compute[75305]:   <devices>
Nov 14 08:28:51 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:28:51 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:28:51 user nova-compute[75305]:       <source dev="/dev/sdd"/>
Nov 14 08:28:51 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:28:51 user nova-compute[75305]:       <serial>6914c93b-dfee-4456-8fca-ca0167a6f908</serial>
Nov 14 08:28:51 user nova-compute[75305]:     </disk>
Nov 14 08:28:51 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:28:51 user nova-compute[75305]:       <mac address="fa:16:3e:e6:31:66"/>
Nov 14 08:28:51 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:28:51 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:28:51 user nova-compute[75305]:       <target dev="tap6f5c842e-52"/>
Nov 14 08:28:51 user nova-compute[75305]:     </interface>
Nov 14 08:28:51 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:28:51 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445/console.log" append="off"/>
Nov 14 08:28:51 user nova-compute[75305]:     </serial>
Nov 14 08:28:51 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:28:51 user nova-compute[75305]:     <video>
Nov 14 08:28:51 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:28:51 user nova-compute[75305]:     </video>
Nov 14 08:28:51 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:28:51 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:28:51 user nova-compute[75305]:     </rng>
Nov 14 08:28:51 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:28:51 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:28:51 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:28:51 user nova-compute[75305]:     </memballoon>
Nov 14 08:28:51 user nova-compute[75305]:   </devices>
Nov 14 08:28:51 user nova-compute[75305]: </domain>
Nov 14 08:28:51 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2076355257',display_name='tempest-TestShelveInstance-server-2076355257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2076355257',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-827370384',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:25:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b48539b5fa2a466bbaa3dbb207c45166',ramdisk_id='',reservation_id='r-nmfr5qsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-578054605',owner_user_name='tempest-TestShelveInstance-578054605-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:28:43Z,user_data=None,user_id='1aa7ff0836d24d11ba27accb25936704',uuid=4a9ba834-e5b3-4001-b511-5810aab0a445,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converting VIF {"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG os_vif [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '912f8ae0-4395-5a6c-8683-11404a0929fa', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f5c842e-52, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6f5c842e-52, col_values=(('qos', UUID('d938a717-477d-4cc9-b399-fd3775ccb588')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6f5c842e-52, col_values=(('external_ids', {'iface-id': '6f5c842e-5213-4a79-9c60-31af22c31952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:31:66', 'vm-uuid': '4a9ba834-e5b3-4001-b511-5810aab0a445'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:51 user nova-compute[75305]: INFO os_vif [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52')
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:28:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] No VIF found with MAC fa:16:3e:e6:31:66, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-4a8370b3-b9d8-4396-9f2e-007b841d61f2 req-9fd56f2e-6284-476b-a6c2-9cb7c630c9d4 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a8370b3-b9d8-4396-9f2e-007b841d61f2 req-9fd56f2e-6284-476b-a6c2-9cb7c630c9d4 service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a8370b3-b9d8-4396-9f2e-007b841d61f2 req-9fd56f2e-6284-476b-a6c2-9cb7c630c9d4 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a8370b3-b9d8-4396-9f2e-007b841d61f2 req-9fd56f2e-6284-476b-a6c2-9cb7c630c9d4 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-4a8370b3-b9d8-4396-9f2e-007b841d61f2 req-9fd56f2e-6284-476b-a6c2-9cb7c630c9d4 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:28:52 user nova-compute[75305]: WARNING nova.compute.manager [req-4a8370b3-b9d8-4396-9f2e-007b841d61f2 req-9fd56f2e-6284-476b-a6c2-9cb7c630c9d4 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received unexpected event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 08:28:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:28:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance spawned successfully.
Nov 14 08:28:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-777b5218-f365-497a-b392-dac8181cd3e9 tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.137s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b4f1f08-304a-4190-b155-f74ad797e127 req-269d7b53-1528-47e2-83f4-a811696bdc1f service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b4f1f08-304a-4190-b155-f74ad797e127 req-269d7b53-1528-47e2-83f4-a811696bdc1f service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b4f1f08-304a-4190-b155-f74ad797e127 req-269d7b53-1528-47e2-83f4-a811696bdc1f service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b4f1f08-304a-4190-b155-f74ad797e127 req-269d7b53-1528-47e2-83f4-a811696bdc1f service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:28:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b4f1f08-304a-4190-b155-f74ad797e127 req-269d7b53-1528-47e2-83f4-a811696bdc1f service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:28:54 user nova-compute[75305]: WARNING nova.compute.manager [req-5b4f1f08-304a-4190-b155-f74ad797e127 req-269d7b53-1528-47e2-83f4-a811696bdc1f service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received unexpected event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with vm_state active and task_state None.
Nov 14 08:28:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:28:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:03 user nova-compute[75305]: INFO nova.compute.manager [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attaching volume ebdbaf99-9960-47e3-a175-af5e3644ea68 to /dev/vdb
Nov 14 08:29:03 user nova-compute[75305]: DEBUG os_brick.utils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:29:03 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a582f45-b7b5-4b80-a659-9e259827d6c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[325fd155-d8e1-41ab-a93a-c5954b5560ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d496f1-04a3-4109-8d63-9e61db8b5c1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a6605-d22c-4a06-aca7-ceb5aab06044]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:29:04 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:29:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11c35e1-2f57-403f-990c-65893f4e8a31]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG os_brick.utils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:29:04 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating existing volume attachment record: 113d41f9-ba36-4325-9da9-5703ec2e75f0 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:29:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNqtlkhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:29:08 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:29:08 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:29:08 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5bf2c6-754b-47c4-8c05-ac45bdfdf730]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:29:08 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[682b3d61-01a1-47a9-8cda-506f55ce8404]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68] added
Nov 14 08:29:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[872e6d43-87fe-42d4-9949-962369e6f5b7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece58824-6962-4ec3-8013-226c2e53916f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNqtlkhA {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xNqtlkhA" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb2e34b-c84e-4743-abd0-bbb61e6e22e6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xNqtlkhA'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61bbfb2-681e-4a2a-b043-b8a14f51c123]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca3e65c-ad31-4330-9451-e2ef6e09e78f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bf165b-1fde-4486-87eb-428b3847ce6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260]
Nov 14 08:29:08 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260] successful.
Nov 14 08:29:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[46141919-bf35-4e16-88f3-948e42f4bd30]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23c3151-ca59-4d35-9c6e-a11233b4d798]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 (non-flash)
Nov 14 08:29:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328d84b-12a7-4562-8146-5006c276b109]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:29:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNqtlkhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:29:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:29:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '23866313164363732', 'path': '/dev/sde'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:29:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866313164363732', 'path': '/dev/sde'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:29:09 user nova-compute[75305]: DEBUG nova.objects.instance [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:29:09 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:29:09 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:29:09 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:29:09 user nova-compute[75305]:   <serial>ebdbaf99-9960-47e3-a175-af5e3644ea68</serial>
Nov 14 08:29:09 user nova-compute[75305]: </disk>
Nov 14 08:29:09 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:29:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:29:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:29:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No VIF found with MAC fa:16:3e:66:3b:8a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:29:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-dcb801f1-4655-411e-8068-34e514fb37e7 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.302s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:12 user nova-compute[75305]: INFO nova.compute.manager [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Detaching volume ebdbaf99-9960-47e3-a175-af5e3644ea68
Nov 14 08:29:12 user nova-compute[75305]: INFO nova.virt.block_device [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attempting to driver detach volume ebdbaf99-9960-47e3-a175-af5e3644ea68 from mountpoint /dev/vdb
Nov 14 08:29:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Attempting to detach device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:29:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:29:12 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:29:12 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:29:12 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:29:12 user nova-compute[75305]:   <serial>ebdbaf99-9960-47e3-a175-af5e3644ea68</serial>
Nov 14 08:29:12 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:29:12 user nova-compute[75305]: </disk>
Nov 14 08:29:12 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:29:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config.
Nov 14 08:29:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:29:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:29:12 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:29:12 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:29:12 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:29:12 user nova-compute[75305]:   <serial>ebdbaf99-9960-47e3-a175-af5e3644ea68</serial>
Nov 14 08:29:12 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:29:12 user nova-compute[75305]: </disk>
Nov 14 08:29:12 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:29:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:29:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 075d5e8d-af7e-4ce1-a0fd-1dededa3b783 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "41effa45-fafa-4575-9f95-f0c43849929a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "41effa45-fafa-4575-9f95-f0c43849929a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:28 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:29:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:29:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:32 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f is timed out.
Nov 14 08:29:32 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config.
Nov 14 08:29:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xNqtlkhA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:29:32 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51533584-1a96-472d-bf14-532df0b73c87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:29:32 user nova-compute[75305]: No targets found.
Nov 14 08:29:32 user nova-compute[75305]: iSNS:
Nov 14 08:29:32 user nova-compute[75305]: No targets found.
Nov 14 08:29:32 user nova-compute[75305]: STATIC:
Nov 14 08:29:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68
Nov 14 08:29:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:29:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:29:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908
Nov 14 08:29:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:29:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:29:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c
Nov 14 08:29:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:29:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:29:32 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7
Nov 14 08:29:32 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:29:32 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:29:32 user nova-compute[75305]: FIRMWARE:
Nov 14 08:29:32 user nova-compute[75305]: No targets found.
Nov 14 08:29:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:29:32 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:29:32 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bc54c3-2060-4297-a673-2adb18435d97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7afbbd48-a725-466f-9559-130ea5468bb8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:29:32 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:29:32 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:29:32 user nova-compute[75305]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 (non-flash)
Nov 14 08:29:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:29:32 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:29:32 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:29:32 user nova-compute[75305]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 (non-flash)
Nov 14 08:29:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5e5e1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68'): ({'sde'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Removing single pathed devices sde {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[152fff78-d8ea-4591-a05f-8d03b41d1531]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c9b564-8671-4b85-8056-a7d1b1c3de97]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Flushing IO for device /dev/sde {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cd6931-7b27-47b7-a816-7ee96db00c8e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[220e48e2-dd07-4db3-a44e-70732558f706]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[259e2c43-a1a5-44fd-8ba1-12e70efe2dde]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43c79b5-d629-4a21-b6eb-a5e79373856e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260]
Nov 14 08:29:32 user nova-compute[75305]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68, portal: 172.16.0.220,3260] successful.
Nov 14 08:29:32 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ebdbaf99-9960-47e3-a175-af5e3644ea68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2618aa-a35a-4495-8711-52d3bda149fe]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== disconnect_volume: return (309ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:29:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:29:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-42460599-c6a0-4b49-b3b0-1b49174d7263 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 12.283s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:36 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:29:36 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:29:36 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8264MB free_disk=24.998260498046875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 075d5e8d-af7e-4ce1-a0fd-1dededa3b783 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 4a9ba834-e5b3-4001-b511-5810aab0a445 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:29:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:39 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:39 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:40 user nova-compute[75305]: INFO nova.compute.manager [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Rescuing
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating instance_info_cache with network_info: [{"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:29:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-b4d7d9a0-87ea-4679-81ec-ddac585abbd6 req-45ddb24b-e3b5-4550-8ef8-ea161f6333a5 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-unplugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b4d7d9a0-87ea-4679-81ec-ddac585abbd6 req-45ddb24b-e3b5-4550-8ef8-ea161f6333a5 service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b4d7d9a0-87ea-4679-81ec-ddac585abbd6 req-45ddb24b-e3b5-4550-8ef8-ea161f6333a5 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b4d7d9a0-87ea-4679-81ec-ddac585abbd6 req-45ddb24b-e3b5-4550-8ef8-ea161f6333a5 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.compute.manager [req-b4d7d9a0-87ea-4679-81ec-ddac585abbd6 req-45ddb24b-e3b5-4550-8ef8-ea161f6333a5 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-unplugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:29:41 user nova-compute[75305]: WARNING nova.compute.manager [req-b4d7d9a0-87ea-4679-81ec-ddac585abbd6 req-45ddb24b-e3b5-4550-8ef8-ea161f6333a5 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received unexpected event network-vif-unplugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with vm_state active and task_state rescuing.
Nov 14 08:29:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance destroyed successfully.
Nov 14 08:29:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Attempting rescue
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:29:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Creating image(s)
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'trusted_certs' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue" returned: 0 in 0.056s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'migration_context' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.base [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<fbf25e85-e17d-4b6b-8a48-40a6009bf129> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Start _get_guest_xml network_info=[{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:72:de:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'resources' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.base [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<fbf25e85-e17d-4b6b-8a48-40a6009bf129> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'numa_topology' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.base [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<fbf25e85-e17d-4b6b-8a48-40a6009bf129> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:29:41 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:29:41 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'vcpu_model' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.objects.base [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<fbf25e85-e17d-4b6b-8a48-40a6009bf129> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319231213',display_name='tempest-ServerRescueNegativeTestJSON-server-1319231213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319231213',id=45,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:27:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-qozz58e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:27:58Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=fbf25e85-e17d-4b6b-8a48-40a6009bf129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:72:de:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:29:41 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:72:de:b0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:29:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:29:42 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'pci_devices' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:29:42 user nova-compute[75305]: DEBUG nova.objects.base [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<fbf25e85-e17d-4b6b-8a48-40a6009bf129> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:29:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:29:42 user nova-compute[75305]:   <uuid>fbf25e85-e17d-4b6b-8a48-40a6009bf129</uuid>
Nov 14 08:29:42 user nova-compute[75305]:   <name>instance-0000002d</name>
Nov 14 08:29:42 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:29:42 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:29:42 user nova-compute[75305]:   <metadata>
Nov 14 08:29:42 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:29:42 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:29:42 user nova-compute[75305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1319231213</nova:name>
Nov 14 08:29:42 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:29:41</nova:creationTime>
Nov 14 08:29:42 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:29:42 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:29:42 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:29:42 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:29:42 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:29:42 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:29:42 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:29:42 user nova-compute[75305]:       <nova:owner>
Nov 14 08:29:42 user nova-compute[75305]:         <nova:user uuid="d9bee7b3e5f0483d94a46fbed06604c5">tempest-ServerRescueNegativeTestJSON-300947473-project-member</nova:user>
Nov 14 08:29:42 user nova-compute[75305]:         <nova:project uuid="7369e5af19a940d69cec15ce79234459">tempest-ServerRescueNegativeTestJSON-300947473</nova:project>
Nov 14 08:29:42 user nova-compute[75305]:       </nova:owner>
Nov 14 08:29:42 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:29:42 user nova-compute[75305]:       <nova:ports>
Nov 14 08:29:42 user nova-compute[75305]:         <nova:port uuid="ccff71eb-24e0-428d-9e54-7c309615fe14">
Nov 14 08:29:42 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 08:29:42 user nova-compute[75305]:         </nova:port>
Nov 14 08:29:42 user nova-compute[75305]:       </nova:ports>
Nov 14 08:29:42 user nova-compute[75305]:     </nova:instance>
Nov 14 08:29:42 user nova-compute[75305]:   </metadata>
Nov 14 08:29:42 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:29:42 user nova-compute[75305]:     <system>
Nov 14 08:29:42 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:29:42 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:29:42 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:29:42 user nova-compute[75305]:       <entry name="serial">fbf25e85-e17d-4b6b-8a48-40a6009bf129</entry>
Nov 14 08:29:42 user nova-compute[75305]:       <entry name="uuid">fbf25e85-e17d-4b6b-8a48-40a6009bf129</entry>
Nov 14 08:29:42 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:29:42 user nova-compute[75305]:     </system>
Nov 14 08:29:42 user nova-compute[75305]:   </sysinfo>
Nov 14 08:29:42 user nova-compute[75305]:   <os>
Nov 14 08:29:42 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:29:42 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:29:42 user nova-compute[75305]:   </os>
Nov 14 08:29:42 user nova-compute[75305]:   <features>
Nov 14 08:29:42 user nova-compute[75305]:     <acpi/>
Nov 14 08:29:42 user nova-compute[75305]:     <apic/>
Nov 14 08:29:42 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:29:42 user nova-compute[75305]:   </features>
Nov 14 08:29:42 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:29:42 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:29:42 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:29:42 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:29:42 user nova-compute[75305]:   </clock>
Nov 14 08:29:42 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:29:42 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:29:42 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:29:42 user nova-compute[75305]:   </cpu>
Nov 14 08:29:42 user nova-compute[75305]:   <devices>
Nov 14 08:29:42 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:29:42 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:29:42 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue"/>
Nov 14 08:29:42 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:29:42 user nova-compute[75305]:     </disk>
Nov 14 08:29:42 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:29:42 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:29:42 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk"/>
Nov 14 08:29:42 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:29:42 user nova-compute[75305]:     </disk>
Nov 14 08:29:42 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:29:42 user nova-compute[75305]:       <mac address="fa:16:3e:72:de:b0"/>
Nov 14 08:29:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:29:42 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:29:42 user nova-compute[75305]:       <target dev="tapccff71eb-24"/>
Nov 14 08:29:42 user nova-compute[75305]:     </interface>
Nov 14 08:29:42 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:29:42 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/console.log" append="off"/>
Nov 14 08:29:42 user nova-compute[75305]:     </serial>
Nov 14 08:29:42 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:29:42 user nova-compute[75305]:     <video>
Nov 14 08:29:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:29:42 user nova-compute[75305]:     </video>
Nov 14 08:29:42 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:29:42 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:29:42 user nova-compute[75305]:     </rng>
Nov 14 08:29:42 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:29:42 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:29:42 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:29:42 user nova-compute[75305]:     </memballoon>
Nov 14 08:29:42 user nova-compute[75305]:   </devices>
Nov 14 08:29:42 user nova-compute[75305]: </domain>
Nov 14 08:29:42 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:29:42 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance destroyed successfully.
Nov 14 08:29:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:29:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:29:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No VIF found with MAC fa:16:3e:72:de:b0, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-4f81150c-eac6-4ce3-a1d0-c55f9b49db40 req-4c6a822e-f13c-4490-9d73-c4d074dd4865 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4f81150c-eac6-4ce3-a1d0-c55f9b49db40 req-4c6a822e-f13c-4490-9d73-c4d074dd4865 service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4f81150c-eac6-4ce3-a1d0-c55f9b49db40 req-4c6a822e-f13c-4490-9d73-c4d074dd4865 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4f81150c-eac6-4ce3-a1d0-c55f9b49db40 req-4c6a822e-f13c-4490-9d73-c4d074dd4865 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG nova.compute.manager [req-4f81150c-eac6-4ce3-a1d0-c55f9b49db40 req-4c6a822e-f13c-4490-9d73-c4d074dd4865 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:29:43 user nova-compute[75305]: WARNING nova.compute.manager [req-4f81150c-eac6-4ce3-a1d0-c55f9b49db40 req-4c6a822e-f13c-4490-9d73-c4d074dd4865 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received unexpected event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with vm_state active and task_state rescuing.
Nov 14 08:29:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:29:45 user nova-compute[75305]: WARNING nova.compute.manager [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received unexpected event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with vm_state active and task_state rescuing.
Nov 14 08:29:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:29:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:29:45 user nova-compute[75305]: WARNING nova.compute.manager [req-8a402f6c-1871-4df4-90d9-bc5de20eed15 req-2022e738-a043-4dcd-bff5-40c9b533599d service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received unexpected event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with vm_state active and task_state rescuing.
Nov 14 08:29:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3cf1b096-8a86-48e0-a20e-934d1425b311 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:29:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:29:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:29:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:29:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:29:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:29:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:29:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:29:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:04 user nova-compute[75305]: INFO nova.compute.manager [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attaching volume 1d3073e2-0a2d-42ca-8953-d6e877d28abb to /dev/vdb
Nov 14 08:30:04 user nova-compute[75305]: DEBUG os_brick.utils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[23480900-bb1e-4ad2-aa8b-38f1216fa06b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb90ba9-1512-4eb9-9f41-9c987cc135fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56e791a-88bc-4da8-a2eb-0f1148e3762f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83d563f-02d6-4c55-9068-f0553d4e1dc9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:30:04 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:30:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[352321bc-e4ed-4089-bbc5-1f9d55f7af4f]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG os_brick.utils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:30:04 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating existing volume attachment record: 8de6a13a-35ad-490a-8b03-0fee8ff9b2b0 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:30:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zryEQhtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:30:08 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:30:08 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:30:08 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4225abb-2752-468b-8946-153710db1df6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:30:08 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[086152b3-19fe-43e6-b404-c913d3f2e404]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb] added
Nov 14 08:30:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5321a66b-1832-45d2-be3e-7a2a75529f23]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6571f3-b47f-459f-868c-85d72ac95255]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zryEQhtU {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zryEQhtU" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[229aae41-3db4-4774-8c2e-0915464bf9f6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zryEQhtU'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[924aa31f-dc48-4bb6-ab90-e4de1f3bafb7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[565328f7-1cb5-4829-a4f0-49ccdedabb16]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c85f34b-422b-4c5b-acb1-d220a383129c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260]
Nov 14 08:30:08 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260] successful.
Nov 14 08:30:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bffe73e-e5be-42af-bf87-88226752257b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f6aea-0d57-456b-9f72-0b159395338e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)
Nov 14 08:30:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:08 user nova-compute[75305]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)
Nov 14 08:30:08 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b44d7ff-01f2-4fbf-b594-b4fb4a74a74b]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:08 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zryEQhtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23739303263353832', 'path': '/dev/sde'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739303263353832', 'path': '/dev/sde'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:30:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:30:09 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:30:09 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:30:09 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:30:09 user nova-compute[75305]:   <serial>1d3073e2-0a2d-42ca-8953-d6e877d28abb</serial>
Nov 14 08:30:09 user nova-compute[75305]: </disk>
Nov 14 08:30:09 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:30:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:30:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:30:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No VIF found with MAC fa:16:3e:66:3b:8a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:30:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f9206bfe-7cdb-4c87-83ea-f0d94ff9b9ba tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.369s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:12 user nova-compute[75305]: INFO nova.compute.manager [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Detaching volume 1d3073e2-0a2d-42ca-8953-d6e877d28abb
Nov 14 08:30:12 user nova-compute[75305]: INFO nova.virt.block_device [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attempting to driver detach volume 1d3073e2-0a2d-42ca-8953-d6e877d28abb from mountpoint /dev/vdb
Nov 14 08:30:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Attempting to detach device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:30:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:30:12 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:30:12 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:30:12 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:30:12 user nova-compute[75305]:   <serial>1d3073e2-0a2d-42ca-8953-d6e877d28abb</serial>
Nov 14 08:30:12 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:30:12 user nova-compute[75305]: </disk>
Nov 14 08:30:12 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:30:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config.
Nov 14 08:30:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:30:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:30:12 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:30:12 user nova-compute[75305]:   <source dev="/dev/sde"/>
Nov 14 08:30:12 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:30:12 user nova-compute[75305]:   <serial>1d3073e2-0a2d-42ca-8953-d6e877d28abb</serial>
Nov 14 08:30:12 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:30:12 user nova-compute[75305]: </disk>
Nov 14 08:30:12 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:30:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:30:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-changed-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Refreshing instance network info cache due to event network-changed-2158ae33-c737-4d7a-affe-47aefc41e73d. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:30:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] Acquiring lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:30:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] Acquired lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:30:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Refreshing network info cache for port 2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG nova.network.neutron [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Updated VIF entry in instance network info cache for port 2158ae33-c737-4d7a-affe-47aefc41e73d. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG nova.network.neutron [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Updating instance_info_cache with network_info: [{"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1de002ca-8d9b-40ec-b07f-ad5373c03b6a req-649d2f6c-34dc-47f0-b340-fb7fe46a4ba4 service nova] Releasing lock "refresh_cache-075d5e8d-af7e-4ce1-a0fd-1dededa3b783" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:21 user nova-compute[75305]: INFO nova.compute.manager [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Terminating instance
Nov 14 08:30:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-3621853c-9842-4348-9b9b-ea4d068d9adc req-bb16c9f5-2ffe-4d81-9c11-dc6d2ced5be0 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-vif-unplugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3621853c-9842-4348-9b9b-ea4d068d9adc req-bb16c9f5-2ffe-4d81-9c11-dc6d2ced5be0 service nova] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3621853c-9842-4348-9b9b-ea4d068d9adc req-bb16c9f5-2ffe-4d81-9c11-dc6d2ced5be0 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3621853c-9842-4348-9b9b-ea4d068d9adc req-bb16c9f5-2ffe-4d81-9c11-dc6d2ced5be0 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-3621853c-9842-4348-9b9b-ea4d068d9adc req-bb16c9f5-2ffe-4d81-9c11-dc6d2ced5be0 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] No waiting events found dispatching network-vif-unplugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-3621853c-9842-4348-9b9b-ea4d068d9adc req-bb16c9f5-2ffe-4d81-9c11-dc6d2ced5be0 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-vif-unplugged-2158ae33-c737-4d7a-affe-47aefc41e73d for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Instance destroyed successfully.
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.objects.instance [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'resources' on Instance uuid 075d5e8d-af7e-4ce1-a0fd-1dededa3b783 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:28:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1767828083',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1767828083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1767828083',id=46,image_ref='ed45f1ac-199d-4ae5-ad11-8b6dcdb5b3ec',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFmQqCyOIr8SZh/cKfY2NsNAca+e87nzHT/WsLxqPzE8ON7mve4Yt2BM3sAtUQUbZSGamLhNcVvF0dVh46gIXmRq8NFi+eT0OyKvV6BjGBrLp1YeZodehBF0hL2hMTQQw==',key_name='tempest-keypair-575202822',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:28:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-75slmd0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1297430060',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:28:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=075d5e8d-af7e-4ce1-a0fd-1dededa3b783,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "2158ae33-c737-4d7a-affe-47aefc41e73d", "address": "fa:16:3e:5f:76:35", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2158ae33-c7", "ovs_interfaceid": "2158ae33-c737-4d7a-affe-47aefc41e73d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:76:35,bridge_name='br-int',has_traffic_filtering=True,id=2158ae33-c737-4d7a-affe-47aefc41e73d,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2158ae33-c7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_vif [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:76:35,bridge_name='br-int',has_traffic_filtering=True,id=2158ae33-c737-4d7a-affe-47aefc41e73d,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2158ae33-c7') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2158ae33-c7, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9693e069-7587-485b-b858-1db7c17fe18f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:22 user nova-compute[75305]: INFO os_vif [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:76:35,bridge_name='br-int',has_traffic_filtering=True,id=2158ae33-c737-4d7a-affe-47aefc41e73d,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2158ae33-c7')
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CDwxHtKq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:30:22 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0519fe-1048-48d2-bb70-f26b8060562a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:30:22 user nova-compute[75305]: No targets found.
Nov 14 08:30:22 user nova-compute[75305]: iSNS:
Nov 14 08:30:22 user nova-compute[75305]: No targets found.
Nov 14 08:30:22 user nova-compute[75305]: STATIC:
Nov 14 08:30:22 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908
Nov 14 08:30:22 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:22 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:22 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c
Nov 14 08:30:22 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:22 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:22 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7
Nov 14 08:30:22 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:22 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:22 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb
Nov 14 08:30:22 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:22 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:22 user nova-compute[75305]: FIRMWARE:
Nov 14 08:30:22 user nova-compute[75305]: No targets found.
Nov 14 08:30:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:30:22 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:30:22 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e33a679-83df-4f22-a1e2-e4a11d82405e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b8a33f-24c0-4fff-b560-0414ca417b03]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:22 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:30:22 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:22 user nova-compute[75305]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)
Nov 14 08:30:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:22 user nova-compute[75305]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 (non-flash)
Nov 14 08:30:22 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:22 user nova-compute[75305]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)
Nov 14 08:30:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442eca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8142d69a-d118-4636-8967-5920ed1d9843]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8777c0-d6c6-4325-8329-6707340d9fd3]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f1ec13-bb3c-4033-b7ea-86e74763b2ab]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[20698a2c-7117-417b-b997-b432acd8d2af]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2d66ef53-661203b527ba5825', '/dev/disk/by-id/scsi-23636313230336235', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2d66ef53') {{(pid=86224) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ef2293-dc2b-457f-a435-662115deff64]: (4, None) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1955816f-e3be-4f3a-b373-cddc7c0232f3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea123264-0c9d-4443-a049-acdbfcceff11]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260]
Nov 14 08:30:22 user nova-compute[75305]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7, portal: 172.16.0.220,3260] successful.
Nov 14 08:30:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c3d30b-9a60-43ea-b837-1b48ca66fdf1]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== disconnect_volume: return (339ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:30:22 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Deleting instance files /opt/stack/data/nova/instances/075d5e8d-af7e-4ce1-a0fd-1dededa3b783_del
Nov 14 08:30:22 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Deletion of /opt/stack/data/nova/instances/075d5e8d-af7e-4ce1-a0fd-1dededa3b783_del complete
Nov 14 08:30:22 user nova-compute[75305]: INFO nova.compute.manager [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 08:30:22 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:30:22 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:30:23 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:30:23 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Took 0.82 seconds to deallocate network for instance.
Nov 14 08:30:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-9d4b77fe-61a2-4878-adb3-4e008239bdfd req-9699bc38-c6fe-4e52-ae56-c39496e899b9 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-vif-deleted-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-9fe286de-242c-47ff-923f-99a273720695 req-5150b9a8-6f8f-4de8-a819-b8d5ac4ac922 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received event network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fe286de-242c-47ff-923f-99a273720695 req-5150b9a8-6f8f-4de8-a819-b8d5ac4ac922 service nova] Acquiring lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fe286de-242c-47ff-923f-99a273720695 req-5150b9a8-6f8f-4de8-a819-b8d5ac4ac922 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9fe286de-242c-47ff-923f-99a273720695 req-5150b9a8-6f8f-4de8-a819-b8d5ac4ac922 service nova] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-9fe286de-242c-47ff-923f-99a273720695 req-5150b9a8-6f8f-4de8-a819-b8d5ac4ac922 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] No waiting events found dispatching network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:30:24 user nova-compute[75305]: WARNING nova.compute.manager [req-9fe286de-242c-47ff-923f-99a273720695 req-5150b9a8-6f8f-4de8-a819-b8d5ac4ac922 service nova] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Received unexpected event network-vif-plugged-2158ae33-c737-4d7a-affe-47aefc41e73d for instance with vm_state active and task_state deleting.
Nov 14 08:30:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:24 user nova-compute[75305]: INFO nova.compute.manager [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 08:30:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 075d5e8d-af7e-4ce1-a0fd-1dededa3b783] Deleting volume: 3f3fad83-dd5d-484e-8451-d1c6ee0a6cf7 {{(pid=75305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:30:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:24 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Deleted allocations for instance 075d5e8d-af7e-4ce1-a0fd-1dededa3b783
Nov 14 08:30:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-934c0374-2de8-482b-89f0-4409a0ab5dad tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "075d5e8d-af7e-4ce1-a0fd-1dededa3b783" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.275s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:29 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:30 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:30:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:30:33 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f is timed out.
Nov 14 08:30:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config.
Nov 14 08:30:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zryEQhtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:30:33 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac30294-08f8-4f9f-b850-5b7990376343]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:30:33 user nova-compute[75305]: No targets found.
Nov 14 08:30:33 user nova-compute[75305]: iSNS:
Nov 14 08:30:33 user nova-compute[75305]: No targets found.
Nov 14 08:30:33 user nova-compute[75305]: STATIC:
Nov 14 08:30:33 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908
Nov 14 08:30:33 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:33 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:33 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c
Nov 14 08:30:33 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:33 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:33 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb
Nov 14 08:30:33 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:33 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:33 user nova-compute[75305]: FIRMWARE:
Nov 14 08:30:33 user nova-compute[75305]: No targets found.
Nov 14 08:30:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:30:33 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:30:33 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1120368-79b8-4679-9f15-9a9c3cedbc96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73e2d1-462a-49ab-aeb7-5ad66e5b9e77]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:33 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:33 user nova-compute[75305]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)
Nov 14 08:30:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:33 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:33 user nova-compute[75305]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb (non-flash)
Nov 14 08:30:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442aa290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb'): ({'sde'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Removing single pathed devices sde {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b55264-1074-4667-bb96-d65681e22b31]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bad358-8ce0-4376-9c77-5327a82450da]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Flushing IO for device /dev/sde {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98c612b-672b-49c8-ae70-af28c8b2512b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[06133e9b-8879-4db9-999d-fc011c9fb39d]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] SCSI volumes sde have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be01b29-0986-4cf5-8590-e26c18bea915]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd805a5-5aab-4327-9db8-5bf32fe25b21]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260]
Nov 14 08:30:33 user nova-compute[75305]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb, portal: 172.16.0.220,3260] successful.
Nov 14 08:30:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d3073e2-0a2d-42ca-8953-d6e877d28abb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a998ed23-5091-4683-93e9-8abaa8724f3e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== disconnect_volume: return (305ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:30:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-52d3a990-42a1-4b93-b9b9-f128d3021b42 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.767s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG nova.compute.manager [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing instance network info cache due to event network-changed-6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] Acquiring lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] Acquired lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG nova.network.neutron [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Refreshing network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:34 user nova-compute[75305]: INFO nova.compute.manager [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Terminating instance
Nov 14 08:30:34 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG nova.network.neutron [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updated VIF entry in instance network info cache for port 6f5c842e-5213-4a79-9c60-31af22c31952. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:30:34 user nova-compute[75305]: DEBUG nova.network.neutron [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [{"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e28acace-ab6d-4f7f-8daf-30e46089590e req-4be1d279-1e68-452f-b454-96c6018ff9ec service nova] Releasing lock "refresh_cache-4a9ba834-e5b3-4001-b511-5810aab0a445" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:30:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Instance destroyed successfully.
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lazy-loading 'resources' on Instance uuid 4a9ba834-e5b3-4001-b511-5810aab0a445 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T08:24:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2076355257',display_name='tempest-TestShelveInstance-server-2076355257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2076355257',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4dp5LFDsgiCVzcuXv4/eVuUgVOq40EjG8sHG8ING0SdThQ6cNdoKkU38WN9fNJ/mgtMBjv35+pZqG23rPt6KhgKHpw1k6UltH/Ndfte3aAYwu76CMHswd6m7GLrPI9Ng==',key_name='tempest-TestShelveInstance-827370384',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:28:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b48539b5fa2a466bbaa3dbb207c45166',ramdisk_id='',reservation_id='r-nmfr5qsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-578054605',owner_user_name='tempest-TestShelveInstance-578054605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:28:55Z,user_data=None,user_id='1aa7ff0836d24d11ba27accb25936704',uuid=4a9ba834-e5b3-4001-b511-5810aab0a445,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converting VIF {"id": "6f5c842e-5213-4a79-9c60-31af22c31952", "address": "fa:16:3e:e6:31:66", "network": {"id": "ea123899-4414-4122-87a1-1f6e181d9307", "bridge": "br-int", "label": "tempest-TestShelveInstance-1754968237-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b48539b5fa2a466bbaa3dbb207c45166", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f5c842e-52", "ovs_interfaceid": "6f5c842e-5213-4a79-9c60-31af22c31952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_vif [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f5c842e-52, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d938a717-477d-4cc9-b399-fd3775ccb588) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:30:35 user nova-compute[75305]: INFO os_vif [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:31:66,bridge_name='br-int',has_traffic_filtering=True,id=6f5c842e-5213-4a79-9c60-31af22c31952,network=Network(ea123899-4414-4122-87a1-1f6e181d9307),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6f5c842e-52')
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mjkQgShO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:30:35 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8fe10f-6dbe-469e-a3fc-a36e423ab395]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:30:35 user nova-compute[75305]: No targets found.
Nov 14 08:30:35 user nova-compute[75305]: iSNS:
Nov 14 08:30:35 user nova-compute[75305]: No targets found.
Nov 14 08:30:35 user nova-compute[75305]: STATIC:
Nov 14 08:30:35 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908
Nov 14 08:30:35 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:35 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:35 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c
Nov 14 08:30:35 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:30:35 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:30:35 user nova-compute[75305]: FIRMWARE:
Nov 14 08:30:35 user nova-compute[75305]: No targets found.
Nov 14 08:30:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:30:35 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:30:35 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b8008-29f9-4f57-aae6-64db18fd7f8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8039d65d-65b3-4c7b-83cf-22f80dccc78a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:35 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:30:35 user nova-compute[75305]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 (non-flash)
Nov 14 08:30:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf54102050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b23be7-4b55-4d40-b516-7a4f83539e47]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e53dd-d98c-4f20-8f8e-271d61268c17]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3711ba1c-60ad-4e15-909e-050ca272dade]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cde7261-1f3f-4fec-b1c8-b98a21d97d31]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[12689467-1fe4-4001-bdf6-e74b2cf9d09e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e261a1fb-019c-45a1-b6df-824e0b26698c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260]
Nov 14 08:30:35 user nova-compute[75305]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908, portal: 172.16.0.220,3260] successful.
Nov 14 08:30:35 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6914c93b-dfee-4456-8fca-ca0167a6f908 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2a336e-0bf9-428e-900a-641aa1ecbbd0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] <== disconnect_volume: return (317ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:30:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Deleting instance files /opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445_del
Nov 14 08:30:35 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Deletion of /opt/stack/data/nova/instances/4a9ba834-e5b3-4001-b511-5810aab0a445_del complete
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: INFO nova.compute.manager [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:30:36 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Took 0.46 seconds to deallocate network for instance.
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:36 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Error from libvirt while getting description of instance-00000029: [Error Code 42] Domain not found: no domain with matching uuid '4a9ba834-e5b3-4001-b511-5810aab0a445' (instance-00000029): libvirt.libvirtError: Domain not found: no domain with matching uuid '4a9ba834-e5b3-4001-b511-5810aab0a445' (instance-00000029)
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-unplugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-unplugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-unplugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] Acquiring lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] No waiting events found dispatching network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:30:36 user nova-compute[75305]: WARNING nova.compute.manager [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received unexpected event network-vif-plugged-6f5c842e-5213-4a79-9c60-31af22c31952 for instance with vm_state active and task_state deleting.
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.compute.manager [req-d4634b65-8e90-4d16-b0b8-2f53c62466cc req-8a8263b4-e224-45ec-929a-d913921e00f9 service nova] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Received event network-vif-deleted-6f5c842e-5213-4a79-9c60-31af22c31952 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:30:36 user nova-compute[75305]: INFO nova.compute.manager [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Took 0.82 seconds to detach 1 volumes for instance.
Nov 14 08:30:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] [instance: 4a9ba834-e5b3-4001-b511-5810aab0a445] Deleting volume: 6914c93b-dfee-4456-8fca-ca0167a6f908 {{(pid=75305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 08:30:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:30:37 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:30:37 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8511MB free_disk=24.987869262695312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 4a9ba834-e5b3-4001-b511-5810aab0a445 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.290s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:30:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:37 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Deleted allocations for instance 4a9ba834-e5b3-4001-b511-5810aab0a445
Nov 14 08:30:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d2bc1e6a-fb2c-4c14-803d-1f288eb52d2d tempest-TestShelveInstance-578054605 tempest-TestShelveInstance-578054605-project-member] Lock "4a9ba834-e5b3-4001-b511-5810aab0a445" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.595s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:30:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:30:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updating instance_info_cache with network_info: [{"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:30:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:30:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:30:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:30:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:31:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG nova.objects.instance [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:04 user nova-compute[75305]: INFO nova.compute.manager [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attaching volume 3460bf04-09b1-440e-be2e-8443a84b18b8 to /dev/vdb
Nov 14 08:31:04 user nova-compute[75305]: DEBUG os_brick.utils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7129b44b-3288-47d1-9613-0f9926e180a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc92550-cc3b-482e-8f1b-1f04c327404e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6582d59-8359-456d-aca0-d977c0fdaccd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b2a04c-43dd-4dc5-9391-5faffe7903ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:31:04 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:31:04 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[36eb99d1-19b3-44de-8041-adb9d9ee8e89]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG os_brick.utils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:31:04 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating existing volume attachment record: 9ec53c78-16c8-4b85-987b-63ba27f39bed {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:31:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:31:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:31:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:31:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:31:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHcKCdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:31:09 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:31:09 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:31:09 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d40342-2a7a-4d84-9f64-5e79da1474bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:31:09 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5304a35-ea21-41b8-9a05-67c20ad81845]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8] added
Nov 14 08:31:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e1f057-9e7d-4422-ae00-028497ae8fc0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c6753f-6462-4582-a8df-50a54dd5b66a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzHcKCdm {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzHcKCdm" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcaf87a3-27d4-45b1-921d-e1a7e2bd7e74]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kzHcKCdm'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e909d8-37e9-4711-a61a-12447bfc1de2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e73021-06fb-46a8-985f-c794c19260c9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:31:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:31:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73cb468-67a1-449a-b26c-18276421174e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260]
Nov 14 08:31:09 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260] successful.
Nov 14 08:31:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca211e-ff77-4c45-89ca-bdb0121d92a5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf3272-28ac-4ec6-a928-d73737fcc6be]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:31:09 user nova-compute[75305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)
Nov 14 08:31:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:31:09 user nova-compute[75305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)
Nov 14 08:31:09 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6dc9f0-c7ed-4521-ba73-baa0a5a61b8b]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:31:09 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHcKCdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26538356562643735', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538356562643735', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG nova.objects.instance [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:31:10 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:31:10 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:31:10 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:31:10 user nova-compute[75305]:   <serial>3460bf04-09b1-440e-be2e-8443a84b18b8</serial>
Nov 14 08:31:10 user nova-compute[75305]: </disk>
Nov 14 08:31:10 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] No VIF found with MAC fa:16:3e:66:3b:8a, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:31:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-0f6edab5-e3b7-4d1e-8466-0533262df62b tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.220s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:12 user nova-compute[75305]: INFO nova.compute.manager [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Detaching volume 3460bf04-09b1-440e-be2e-8443a84b18b8
Nov 14 08:31:12 user nova-compute[75305]: INFO nova.virt.block_device [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Attempting to driver detach volume 3460bf04-09b1-440e-be2e-8443a84b18b8 from mountpoint /dev/vdb
Nov 14 08:31:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Attempting to detach device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:31:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:31:12 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:31:12 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:31:12 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:31:12 user nova-compute[75305]:   <serial>3460bf04-09b1-440e-be2e-8443a84b18b8</serial>
Nov 14 08:31:12 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:31:12 user nova-compute[75305]: </disk>
Nov 14 08:31:12 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:31:12 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the persistent domain config.
Nov 14 08:31:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:31:12 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:31:12 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:31:12 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:31:12 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:31:12 user nova-compute[75305]:   <serial>3460bf04-09b1-440e-be2e-8443a84b18b8</serial>
Nov 14 08:31:12 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:31:12 user nova-compute[75305]: </disk>
Nov 14 08:31:12 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:13 user nova-compute[75305]: INFO nova.compute.manager [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Terminating instance
Nov 14 08:31:13 user nova-compute[75305]: DEBUG nova.compute.manager [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-c5a6c299-227b-4c68-9745-f215dd105414 req-13e83e07-de86-49f0-9fdc-9cc444b0ad71 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-vif-unplugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c5a6c299-227b-4c68-9745-f215dd105414 req-13e83e07-de86-49f0-9fdc-9cc444b0ad71 service nova] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c5a6c299-227b-4c68-9745-f215dd105414 req-13e83e07-de86-49f0-9fdc-9cc444b0ad71 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c5a6c299-227b-4c68-9745-f215dd105414 req-13e83e07-de86-49f0-9fdc-9cc444b0ad71 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-c5a6c299-227b-4c68-9745-f215dd105414 req-13e83e07-de86-49f0-9fdc-9cc444b0ad71 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] No waiting events found dispatching network-vif-unplugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:31:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-c5a6c299-227b-4c68-9745-f215dd105414 req-13e83e07-de86-49f0-9fdc-9cc444b0ad71 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-vif-unplugged-77e36f2f-52de-4735-8c82-a937cecaa405 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:14 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Instance destroyed successfully.
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.objects.instance [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'resources' on Instance uuid fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:26:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-689832123',display_name='tempest-TestVolumeBootPattern-volume-backed-server-689832123',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-689832123',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeGJifp1NS/syXsZQD7PWvQybXVA4lGimCX1eG4lqstdeVMq9qwBuYc7uGbG60wuLaK711qORN0L9MZuUrZTh67VG9tISLWYv4K3JQwaFodwWfGw5wlFff5KvTxqpPgFQ==',key_name='tempest-keypair-1849401724',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:26:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-9cx0y15e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:26:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "77e36f2f-52de-4735-8c82-a937cecaa405", "address": "fa:16:3e:47:20:aa", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77e36f2f-52", "ovs_interfaceid": "77e36f2f-52de-4735-8c82-a937cecaa405", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:20:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e36f2f-52de-4735-8c82-a937cecaa405,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e36f2f-52') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_vif [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:20:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e36f2f-52de-4735-8c82-a937cecaa405,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e36f2f-52') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77e36f2f-52, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aaefb6c-d88e-47a7-9b69-be3d0415b9c6) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:31:14 user nova-compute[75305]: INFO os_vif [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:20:aa,bridge_name='br-int',has_traffic_filtering=True,id=77e36f2f-52de-4735-8c82-a937cecaa405,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77e36f2f-52')
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FPIVRWZt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:31:14 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[831cc957-691d-4a7f-ad39-11fe96b265eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:31:14 user nova-compute[75305]: No targets found.
Nov 14 08:31:14 user nova-compute[75305]: iSNS:
Nov 14 08:31:14 user nova-compute[75305]: No targets found.
Nov 14 08:31:14 user nova-compute[75305]: STATIC:
Nov 14 08:31:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8
Nov 14 08:31:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:31:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:31:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c
Nov 14 08:31:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:31:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:31:14 user nova-compute[75305]: FIRMWARE:
Nov 14 08:31:14 user nova-compute[75305]: No targets found.
Nov 14 08:31:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:31:14 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:31:14 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[91895b96-e92e-42e5-bf04-c1eac4db19ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[88076379-a008-4fac-a7fe-2b0467b90c4b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:31:14 user nova-compute[75305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)
Nov 14 08:31:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c (non-flash)
Nov 14 08:31:14 user nova-compute[75305]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)
Nov 14 08:31:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf5c264ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2173e7c-ca82-4280-b6f5-97485ae8c71d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bd91e2-167d-4e86-8dd9-1de138dfb668]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c24d785-4c2d-4178-b925-9f83ffdb7ad2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2ee43-6451-4022-ba64-c1d4c8e861c7]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e917cb-ea75-4059-b4dc-b7399ce5c9d9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec05f58-efcb-4362-ac17-b9093672f71b]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260]
Nov 14 08:31:14 user nova-compute[75305]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c, portal: 172.16.0.220,3260] successful.
Nov 14 08:31:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a04280-6f6f-4b3f-8578-d8279b02762c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab77a49-ab42-4acc-9cec-f8b6908ad3b9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== disconnect_volume: return (298ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:31:14 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Deleting instance files /opt/stack/data/nova/instances/fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d_del
Nov 14 08:31:14 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Deletion of /opt/stack/data/nova/instances/fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d_del complete
Nov 14 08:31:14 user nova-compute[75305]: INFO nova.compute.manager [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 14 08:31:14 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:31:14 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:31:15 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:31:15 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Took 0.97 seconds to deallocate network for instance.
Nov 14 08:31:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-e3f1ec26-0592-41d6-946a-d8e4f20cb1f9 req-44af3b36-ac0c-48da-93c4-787da2eda14a service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-vif-deleted-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:31:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-200af885-be4f-4d3b-953c-d07546f9f665 req-8bbdb969-6280-4bc1-9770-a5f382ce0d13 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received event network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:31:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-200af885-be4f-4d3b-953c-d07546f9f665 req-8bbdb969-6280-4bc1-9770-a5f382ce0d13 service nova] Acquiring lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-200af885-be4f-4d3b-953c-d07546f9f665 req-8bbdb969-6280-4bc1-9770-a5f382ce0d13 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-200af885-be4f-4d3b-953c-d07546f9f665 req-8bbdb969-6280-4bc1-9770-a5f382ce0d13 service nova] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:15 user nova-compute[75305]: DEBUG nova.compute.manager [req-200af885-be4f-4d3b-953c-d07546f9f665 req-8bbdb969-6280-4bc1-9770-a5f382ce0d13 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] No waiting events found dispatching network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:31:15 user nova-compute[75305]: WARNING nova.compute.manager [req-200af885-be4f-4d3b-953c-d07546f9f665 req-8bbdb969-6280-4bc1-9770-a5f382ce0d13 service nova] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Received unexpected event network-vif-plugged-77e36f2f-52de-4735-8c82-a937cecaa405 for instance with vm_state active and task_state deleting.
Nov 14 08:31:16 user nova-compute[75305]: INFO nova.compute.manager [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Took 0.68 seconds to detach 1 volumes for instance.
Nov 14 08:31:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d] Deleting volume: c4a04280-6f6f-4b3f-8578-d8279b02762c {{(pid=75305) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 08:31:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:16 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:31:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:31:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:16 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Deleted allocations for instance fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d
Nov 14 08:31:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-edeae59d-f0f1-4078-8b3e-e5eda0997db3 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "fa94ed3e-9c5e-4b49-b0d2-ddb133a04d1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.375s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:30 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:31 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:33 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f is timed out.
Nov 14 08:31:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully detached device vdb from instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f from the live domain config.
Nov 14 08:31:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzHcKCdm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:31:33 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f075fa-3a3f-48f7-91c5-d793bb38279f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:31:33 user nova-compute[75305]: No targets found.
Nov 14 08:31:33 user nova-compute[75305]: iSNS:
Nov 14 08:31:33 user nova-compute[75305]: No targets found.
Nov 14 08:31:33 user nova-compute[75305]: STATIC:
Nov 14 08:31:33 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8
Nov 14 08:31:33 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:31:33 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:31:33 user nova-compute[75305]: FIRMWARE:
Nov 14 08:31:33 user nova-compute[75305]: No targets found.
Nov 14 08:31:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:31:33 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:31:33 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afd5a41-4486-41f5-b569-0c14ecb80d34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02ca9e2-5e87-486c-902a-697c31a0d4bf]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)
Nov 14 08:31:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 (non-flash)
Nov 14 08:31:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442ef1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a362a84c-1e12-4ccb-9ebb-09f06f929f77]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b738433-3acc-4ee5-92a6-087a52d84c1f]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d34273-d72a-4239-bc4c-a434426f7bba]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d43d03-514b-4df1-8296-7008ab850a58]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40abf06f-599e-4d17-80d2-5161e2784599]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a64299-5559-45cf-a612-3484dd62c806]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260]
Nov 14 08:31:33 user nova-compute[75305]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8, portal: 172.16.0.220,3260] successful.
Nov 14 08:31:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3460bf04-09b1-440e-be2e-8443a84b18b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8170b4fd-a158-42b6-9b24-45d85b4186c0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] <== disconnect_volume: return (260ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:31:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:31:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'flavor' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:31:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-58d63c9c-6fcc-4747-9113-76afe48ac4d8 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.537s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:31:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:31:37 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:31:37 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=24.986045837402344GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:31:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:31:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:39 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:31:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:31:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:31:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:32:11 user nova-compute[75305]: INFO nova.compute.claims [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Claim successful on node user
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:32:11 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:32:11 user nova-compute[75305]: INFO nova.virt.block_device [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Booting with volume a8985391-61a2-4abd-90ef-0cedcdc623a9 at /dev/vda
Nov 14 08:32:11 user nova-compute[75305]: DEBUG nova.policy [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347d5cb8a22e49948b1c210d2d62ce2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a5b13c6fbb417184c70151551cd2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG os_brick.utils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6369c1ca-dd1d-4f70-9dda-3854c77a41dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6ce608-ac82-433b-9920-f1d7832a2e94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[98170428-f940-4e06-b23e-c42f89bd4038]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaebe3e-3a17-46e2-8259-4ad2f1fe22c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:32:12 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:32:12 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b96aab-3b29-4cb4-bd9d-98c5a8ec624e]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG os_brick.utils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Updating existing volume attachment record: 6a273d33-9384-4f5d-921a-f552a49b6388 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:32:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Successfully created port: 15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Successfully updated port: 15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquired lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-changed-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.compute.manager [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Refreshing instance network info cache due to event network-changed-15534011-032b-4fa7-abb8-01c3a4339721. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] Acquiring lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.network.neutron [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Updating instance_info_cache with network_info: [{"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Releasing lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Instance network_info: |[{"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] Acquired lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:32:13 user nova-compute[75305]: DEBUG nova.network.neutron [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Refreshing network info cache for port 15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:32:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Updated VIF entry in instance network info cache for port 15534011-032b-4fa7-abb8-01c3a4339721. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:32:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Updating instance_info_cache with network_info: [{"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:32:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5b7441fb-58fd-49c6-8fdc-58f30df33a19 req-4a651809-759d-46c6-baa3-7a93d4dbfcdf service nova] Releasing lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:15 user nova-compute[75305]: INFO nova.compute.manager [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Terminating instance
Nov 14 08:32:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-ce5d37fc-1d6f-4dad-a95c-876ab61cd6de req-ac500864-6b99-4f8b-befd-0a28c4ace181 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-vif-unplugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ce5d37fc-1d6f-4dad-a95c-876ab61cd6de req-ac500864-6b99-4f8b-befd-0a28c4ace181 service nova] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ce5d37fc-1d6f-4dad-a95c-876ab61cd6de req-ac500864-6b99-4f8b-befd-0a28c4ace181 service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ce5d37fc-1d6f-4dad-a95c-876ab61cd6de req-ac500864-6b99-4f8b-befd-0a28c4ace181 service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-ce5d37fc-1d6f-4dad-a95c-876ab61cd6de req-ac500864-6b99-4f8b-befd-0a28c4ace181 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] No waiting events found dispatching network-vif-unplugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.compute.manager [req-ce5d37fc-1d6f-4dad-a95c-876ab61cd6de req-ac500864-6b99-4f8b-befd-0a28c4ace181 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-vif-unplugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:32:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Instance destroyed successfully.
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.objects.instance [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lazy-loading 'resources' on Instance uuid 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:26:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-995547992',display_name='tempest-SnapshotDataIntegrityTests-server-995547992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-995547992',id=42,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeRHiZOAvrNmIaQcTVo4MI6IdE55B6GvCQpEUhZPJWWiMC05BbLXM1UFugkks394fu6VcAXZGRIZ7svzq5pCj4Kmk+YQH/DXedWY67lPppFW9gIo23fJ3nG6zNDYmBQKw==',key_name='tempest-keypair-1870962507',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:26:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2c82e1333b5b4e4d80dbbf4a8925a6b3',ramdisk_id='',reservation_id='r-my2ko0th',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-162218343',owner_user_name='tempest-SnapshotDataIntegrityTests-162218343-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='21d44248f2c74b498c1e0f2fdb5ce3c2',uuid=5e9b6777-7e5c-4a9e-a077-deb7d0c9790f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Converting VIF {"id": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "address": "fa:16:3e:66:3b:8a", "network": {"id": "d3bd36d3-ba1c-402f-96a0-c6cad54a4861", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-523470040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2c82e1333b5b4e4d80dbbf4a8925a6b3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f7eb4a-c7", "ovs_interfaceid": "71f7eb4a-c7f7-4f81-86b3-9267b28881ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:3b:8a,bridge_name='br-int',has_traffic_filtering=True,id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab,network=Network(d3bd36d3-ba1c-402f-96a0-c6cad54a4861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f7eb4a-c7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_vif [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:3b:8a,bridge_name='br-int',has_traffic_filtering=True,id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab,network=Network(d3bd36d3-ba1c-402f-96a0-c6cad54a4861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f7eb4a-c7') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71f7eb4a-c7, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5d007d1-b649-4b00-8971-19cc54af9fa2) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:32:16 user nova-compute[75305]: INFO os_vif [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:3b:8a,bridge_name='br-int',has_traffic_filtering=True,id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab,network=Network(d3bd36d3-ba1c-402f-96a0-c6cad54a4861),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f7eb4a-c7')
Nov 14 08:32:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Deleting instance files /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f_del
Nov 14 08:32:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Deletion of /opt/stack/data/nova/instances/5e9b6777-7e5c-4a9e-a077-deb7d0c9790f_del complete
Nov 14 08:32:16 user nova-compute[75305]: INFO nova.compute.manager [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:32:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Creating image(s)
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Ensure instance console log exists: /opt/stack/data/nova/instances/bb799710-2281-4d73-a7ef-3b8ea9b6aaaf/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Start _get_guest_xml network_info=[{"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '6a273d33-9384-4f5d-921a-f552a49b6388', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bb799710-2281-4d73-a7ef-3b8ea9b6aaaf', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8985391-61a2-4abd-90ef-0cedcdc623a9', 'serial': 'a8985391-61a2-4abd-90ef-0cedcdc623a9'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:32:16 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:32:16 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:32:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:32:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:32:16 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd7683-b50d-4fba-a19e-c4a2dad7f826]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:32:16 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51ed896-43dd-4c71-b766-76432f3d81ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9] added
Nov 14 08:32:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d1ec0-77f9-42f3-b109-19bddcd1480b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2632e9-2fae-472e-a1eb-31f55b89ecdd]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDnijVph {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDnijVph" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef44a9-8af6-4eca-ac31-7b0f74c62f7f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wDnijVph'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4666f53f-70e0-4460-afef-eb2759f5d2a3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc645b1d-9199-4ae1-b3b4-5a95260bfcf4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:32:16 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:32:16 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:32:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 08:32:16 user nova-compute[75305]: 
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[746ba747-6953-440f-aa78-8e74acd14804]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]
Nov 14 08:32:16 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.
Nov 14 08:32:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2011afbb-9720-4aca-9acc-49e0599f745c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5f3f1b-5892-4a77-b8fd-e9eb001d2c64]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:32:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:32:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[616dba61-acfe-4883-9e0b-4a4da4d6e771]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:32:17 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Took 0.95 seconds to deallocate network for instance.
Nov 14 08:32:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c4b63e4-513c-44d7-aa58-32302c05b4c8 req-bb1b70c5-9b95-463d-88c1-528f4acf1f11 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-vif-deleted-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:17 user nova-compute[75305]: INFO nova.compute.manager [req-2c4b63e4-513c-44d7-aa58-32302c05b4c8 req-bb1b70c5-9b95-463d-88c1-528f4acf1f11 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Neutron deleted interface 71f7eb4a-c7f7-4f81-86b3-9267b28881ab; detaching it from the instance and deleting it from the info cache
Nov 14 08:32:17 user nova-compute[75305]: DEBUG nova.network.neutron [req-2c4b63e4-513c-44d7-aa58-32302c05b4c8 req-bb1b70c5-9b95-463d-88c1-528f4acf1f11 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG nova.compute.manager [req-2c4b63e4-513c-44d7-aa58-32302c05b4c8 req-bb1b70c5-9b95-463d-88c1-528f4acf1f11 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Detach interface failed, port_id=71f7eb4a-c7f7-4f81-86b3-9267b28881ab, reason: Instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f could not be found. {{(pid=75305) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:17 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Deleted allocations for instance 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f
Nov 14 08:32:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-49d379a1-8289-470e-8472-77c9b847b188 tempest-SnapshotDataIntegrityTests-162218343 tempest-SnapshotDataIntegrityTests-162218343-project-member] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23965656230306233', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965656230306233', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-307694048',display_name='tempest-TestVolumeBootPattern-server-307694048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-307694048',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-yplfwmmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:32:12Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=bb799710-2281-4d73-a7ef-3b8ea9b6aaaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9a:39,bridge_name='br-int',has_traffic_filtering=True,id=15534011-032b-4fa7-abb8-01c3a4339721,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15534011-03') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.objects.instance [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'pci_devices' on Instance uuid bb799710-2281-4d73-a7ef-3b8ea9b6aaaf {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:32:18 user nova-compute[75305]:   <uuid>bb799710-2281-4d73-a7ef-3b8ea9b6aaaf</uuid>
Nov 14 08:32:18 user nova-compute[75305]:   <name>instance-0000002f</name>
Nov 14 08:32:18 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:32:18 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:32:18 user nova-compute[75305]:   <metadata>
Nov 14 08:32:18 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:32:18 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:32:18 user nova-compute[75305]:       <nova:name>tempest-TestVolumeBootPattern-server-307694048</nova:name>
Nov 14 08:32:18 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:32:16</nova:creationTime>
Nov 14 08:32:18 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:32:18 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:32:18 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:32:18 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:32:18 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:32:18 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:32:18 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:32:18 user nova-compute[75305]:       <nova:owner>
Nov 14 08:32:18 user nova-compute[75305]:         <nova:user uuid="347d5cb8a22e49948b1c210d2d62ce2b">tempest-TestVolumeBootPattern-1297430060-project-member</nova:user>
Nov 14 08:32:18 user nova-compute[75305]:         <nova:project uuid="37a5b13c6fbb417184c70151551cd2a4">tempest-TestVolumeBootPattern-1297430060</nova:project>
Nov 14 08:32:18 user nova-compute[75305]:       </nova:owner>
Nov 14 08:32:18 user nova-compute[75305]:       <nova:ports>
Nov 14 08:32:18 user nova-compute[75305]:         <nova:port uuid="15534011-032b-4fa7-abb8-01c3a4339721">
Nov 14 08:32:18 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 08:32:18 user nova-compute[75305]:         </nova:port>
Nov 14 08:32:18 user nova-compute[75305]:       </nova:ports>
Nov 14 08:32:18 user nova-compute[75305]:     </nova:instance>
Nov 14 08:32:18 user nova-compute[75305]:   </metadata>
Nov 14 08:32:18 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:32:18 user nova-compute[75305]:     <system>
Nov 14 08:32:18 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:32:18 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:32:18 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:32:18 user nova-compute[75305]:       <entry name="serial">bb799710-2281-4d73-a7ef-3b8ea9b6aaaf</entry>
Nov 14 08:32:18 user nova-compute[75305]:       <entry name="uuid">bb799710-2281-4d73-a7ef-3b8ea9b6aaaf</entry>
Nov 14 08:32:18 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:32:18 user nova-compute[75305]:     </system>
Nov 14 08:32:18 user nova-compute[75305]:   </sysinfo>
Nov 14 08:32:18 user nova-compute[75305]:   <os>
Nov 14 08:32:18 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:32:18 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:32:18 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:32:18 user nova-compute[75305]:   </os>
Nov 14 08:32:18 user nova-compute[75305]:   <features>
Nov 14 08:32:18 user nova-compute[75305]:     <acpi/>
Nov 14 08:32:18 user nova-compute[75305]:     <apic/>
Nov 14 08:32:18 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:32:18 user nova-compute[75305]:   </features>
Nov 14 08:32:18 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:32:18 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:32:18 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:32:18 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:32:18 user nova-compute[75305]:   </clock>
Nov 14 08:32:18 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:32:18 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:32:18 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:32:18 user nova-compute[75305]:   </cpu>
Nov 14 08:32:18 user nova-compute[75305]:   <devices>
Nov 14 08:32:18 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:32:18 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:32:18 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:32:18 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:32:18 user nova-compute[75305]:       <serial>a8985391-61a2-4abd-90ef-0cedcdc623a9</serial>
Nov 14 08:32:18 user nova-compute[75305]:     </disk>
Nov 14 08:32:18 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:32:18 user nova-compute[75305]:       <mac address="fa:16:3e:b0:9a:39"/>
Nov 14 08:32:18 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:32:18 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:32:18 user nova-compute[75305]:       <target dev="tap15534011-03"/>
Nov 14 08:32:18 user nova-compute[75305]:     </interface>
Nov 14 08:32:18 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:32:18 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/bb799710-2281-4d73-a7ef-3b8ea9b6aaaf/console.log" append="off"/>
Nov 14 08:32:18 user nova-compute[75305]:     </serial>
Nov 14 08:32:18 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:32:18 user nova-compute[75305]:     <video>
Nov 14 08:32:18 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:32:18 user nova-compute[75305]:     </video>
Nov 14 08:32:18 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:32:18 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:32:18 user nova-compute[75305]:     </rng>
Nov 14 08:32:18 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:32:18 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:32:18 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:32:18 user nova-compute[75305]:     </memballoon>
Nov 14 08:32:18 user nova-compute[75305]:   </devices>
Nov 14 08:32:18 user nova-compute[75305]: </domain>
Nov 14 08:32:18 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-307694048',display_name='tempest-TestVolumeBootPattern-server-307694048',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-307694048',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-yplfwmmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:32:12Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=bb799710-2281-4d73-a7ef-3b8ea9b6aaaf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9a:39,bridge_name='br-int',has_traffic_filtering=True,id=15534011-032b-4fa7-abb8-01c3a4339721,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15534011-03') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG os_vif [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9a:39,bridge_name='br-int',has_traffic_filtering=True,id=15534011-032b-4fa7-abb8-01c3a4339721,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15534011-03') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f45ebfb1-cc51-5b5c-957d-bce3fdaebb8e', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15534011-03, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15534011-03, col_values=(('qos', UUID('b7c5e64a-97aa-4d1d-aa86-aabbf1706105')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15534011-03, col_values=(('external_ids', {'iface-id': '15534011-032b-4fa7-abb8-01c3a4339721', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:9a:39', 'vm-uuid': 'bb799710-2281-4d73-a7ef-3b8ea9b6aaaf'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-3a4203a0-709a-42db-a572-21f889fee8e1 req-57159d9a-4e21-41b0-b8aa-32d3c0882df6 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received event network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3a4203a0-709a-42db-a572-21f889fee8e1 req-57159d9a-4e21-41b0-b8aa-32d3c0882df6 service nova] Acquiring lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3a4203a0-709a-42db-a572-21f889fee8e1 req-57159d9a-4e21-41b0-b8aa-32d3c0882df6 service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-3a4203a0-709a-42db-a572-21f889fee8e1 req-57159d9a-4e21-41b0-b8aa-32d3c0882df6 service nova] Lock "5e9b6777-7e5c-4a9e-a077-deb7d0c9790f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-3a4203a0-709a-42db-a572-21f889fee8e1 req-57159d9a-4e21-41b0-b8aa-32d3c0882df6 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] No waiting events found dispatching network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:18 user nova-compute[75305]: WARNING nova.compute.manager [req-3a4203a0-709a-42db-a572-21f889fee8e1 req-57159d9a-4e21-41b0-b8aa-32d3c0882df6 service nova] [instance: 5e9b6777-7e5c-4a9e-a077-deb7d0c9790f] Received unexpected event network-vif-plugged-71f7eb4a-c7f7-4f81-86b3-9267b28881ab for instance with vm_state deleted and task_state None.
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:18 user nova-compute[75305]: INFO os_vif [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:9a:39,bridge_name='br-int',has_traffic_filtering=True,id=15534011-032b-4fa7-abb8-01c3a4339721,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15534011-03')
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:32:18 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No VIF found with MAC fa:16:3e:b0:9a:39, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:32:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] Acquiring lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] No waiting events found dispatching network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:20 user nova-compute[75305]: WARNING nova.compute.manager [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received unexpected event network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 for instance with vm_state building and task_state spawning.
Nov 14 08:32:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] Acquiring lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] No waiting events found dispatching network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:20 user nova-compute[75305]: WARNING nova.compute.manager [req-24d9c73f-0a73-462f-86fd-5d69b9a795d9 req-8d72d078-fd0b-4229-8ae8-b02efa4aace0 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received unexpected event network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 for instance with vm_state building and task_state spawning.
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:32:21 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Instance spawned successfully.
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:32:21 user nova-compute[75305]: INFO nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Took 4.77 seconds to spawn the instance on the hypervisor.
Nov 14 08:32:21 user nova-compute[75305]: DEBUG nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:32:21 user nova-compute[75305]: INFO nova.compute.manager [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Took 10.10 seconds to build instance.
Nov 14 08:32:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-7619215a-9644-4091-a0a9-28c98f8cd71d tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.202s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:32 user nova-compute[75305]: INFO nova.compute.manager [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Rescuing
Nov 14 08:32:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:32:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:32:32 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d088c90-7bf1-4cfa-b373-e42a4d613428 req-8c18cfa9-babf-4c03-8633-a14e17bb70ce service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d088c90-7bf1-4cfa-b373-e42a4d613428 req-8c18cfa9-babf-4c03-8633-a14e17bb70ce service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d088c90-7bf1-4cfa-b373-e42a4d613428 req-8c18cfa9-babf-4c03-8633-a14e17bb70ce service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4d088c90-7bf1-4cfa-b373-e42a4d613428 req-8c18cfa9-babf-4c03-8633-a14e17bb70ce service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG nova.compute.manager [req-4d088c90-7bf1-4cfa-b373-e42a4d613428 req-8c18cfa9-babf-4c03-8633-a14e17bb70ce service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:33 user nova-compute[75305]: WARNING nova.compute.manager [req-4d088c90-7bf1-4cfa-b373-e42a4d613428 req-8c18cfa9-babf-4c03-8633-a14e17bb70ce service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state active and task_state rescuing.
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance destroyed successfully.
Nov 14 08:32:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Attempting rescue
Nov 14 08:32:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:32:34 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Creating image(s)
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'trusted_certs' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue" returned: 0 in 0.052s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'migration_context' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<41effa45-fafa-4575-9f95-f0c43849929a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Start _get_guest_xml network_info=[{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:cd:9e:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'resources' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<41effa45-fafa-4575-9f95-f0c43849929a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'numa_topology' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<41effa45-fafa-4575-9f95-f0c43849929a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:32:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:32:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'vcpu_model' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<41effa45-fafa-4575-9f95-f0c43849929a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1192194542',display_name='tempest-ServerRescueNegativeTestJSON-server-1192194542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1192194542',id=44,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:27:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-stjl4hgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:27:58Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=41effa45-fafa-4575-9f95-f0c43849929a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:cd:9e:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:cd:9e:d1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'pci_devices' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<41effa45-fafa-4575-9f95-f0c43849929a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:32:34 user nova-compute[75305]:   <uuid>41effa45-fafa-4575-9f95-f0c43849929a</uuid>
Nov 14 08:32:34 user nova-compute[75305]:   <name>instance-0000002c</name>
Nov 14 08:32:34 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:32:34 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:32:34 user nova-compute[75305]:   <metadata>
Nov 14 08:32:34 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:32:34 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:32:34 user nova-compute[75305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1192194542</nova:name>
Nov 14 08:32:34 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:32:34</nova:creationTime>
Nov 14 08:32:34 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:32:34 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:32:34 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:32:34 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:32:34 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:32:34 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:32:34 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:32:34 user nova-compute[75305]:       <nova:owner>
Nov 14 08:32:34 user nova-compute[75305]:         <nova:user uuid="d9bee7b3e5f0483d94a46fbed06604c5">tempest-ServerRescueNegativeTestJSON-300947473-project-member</nova:user>
Nov 14 08:32:34 user nova-compute[75305]:         <nova:project uuid="7369e5af19a940d69cec15ce79234459">tempest-ServerRescueNegativeTestJSON-300947473</nova:project>
Nov 14 08:32:34 user nova-compute[75305]:       </nova:owner>
Nov 14 08:32:34 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:32:34 user nova-compute[75305]:       <nova:ports>
Nov 14 08:32:34 user nova-compute[75305]:         <nova:port uuid="08a6385a-27d3-47f4-99b9-0c13142d2a9b">
Nov 14 08:32:34 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 08:32:34 user nova-compute[75305]:         </nova:port>
Nov 14 08:32:34 user nova-compute[75305]:       </nova:ports>
Nov 14 08:32:34 user nova-compute[75305]:     </nova:instance>
Nov 14 08:32:34 user nova-compute[75305]:   </metadata>
Nov 14 08:32:34 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:32:34 user nova-compute[75305]:     <system>
Nov 14 08:32:34 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:32:34 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:32:34 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:32:34 user nova-compute[75305]:       <entry name="serial">41effa45-fafa-4575-9f95-f0c43849929a</entry>
Nov 14 08:32:34 user nova-compute[75305]:       <entry name="uuid">41effa45-fafa-4575-9f95-f0c43849929a</entry>
Nov 14 08:32:34 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:32:34 user nova-compute[75305]:     </system>
Nov 14 08:32:34 user nova-compute[75305]:   </sysinfo>
Nov 14 08:32:34 user nova-compute[75305]:   <os>
Nov 14 08:32:34 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:32:34 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:32:34 user nova-compute[75305]:   </os>
Nov 14 08:32:34 user nova-compute[75305]:   <features>
Nov 14 08:32:34 user nova-compute[75305]:     <acpi/>
Nov 14 08:32:34 user nova-compute[75305]:     <apic/>
Nov 14 08:32:34 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:32:34 user nova-compute[75305]:   </features>
Nov 14 08:32:34 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:32:34 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:32:34 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:32:34 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:32:34 user nova-compute[75305]:   </clock>
Nov 14 08:32:34 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:32:34 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:32:34 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:32:34 user nova-compute[75305]:   </cpu>
Nov 14 08:32:34 user nova-compute[75305]:   <devices>
Nov 14 08:32:34 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:32:34 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:32:34 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue"/>
Nov 14 08:32:34 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:32:34 user nova-compute[75305]:     </disk>
Nov 14 08:32:34 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:32:34 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:32:34 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk"/>
Nov 14 08:32:34 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:32:34 user nova-compute[75305]:     </disk>
Nov 14 08:32:34 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:32:34 user nova-compute[75305]:       <mac address="fa:16:3e:cd:9e:d1"/>
Nov 14 08:32:34 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:32:34 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:32:34 user nova-compute[75305]:       <target dev="tap08a6385a-27"/>
Nov 14 08:32:34 user nova-compute[75305]:     </interface>
Nov 14 08:32:34 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:32:34 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/console.log" append="off"/>
Nov 14 08:32:34 user nova-compute[75305]:     </serial>
Nov 14 08:32:34 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:32:34 user nova-compute[75305]:     <video>
Nov 14 08:32:34 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:32:34 user nova-compute[75305]:     </video>
Nov 14 08:32:34 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:32:34 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:32:34 user nova-compute[75305]:     </rng>
Nov 14 08:32:34 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:32:34 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:32:34 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:32:34 user nova-compute[75305]:     </memballoon>
Nov 14 08:32:34 user nova-compute[75305]:   </devices>
Nov 14 08:32:34 user nova-compute[75305]: </domain>
Nov 14 08:32:34 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:32:34 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance destroyed successfully.
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:32:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No VIF found with MAC fa:16:3e:cd:9e:d1, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d2400526-8c9e-4a40-8361-a5657f2d3ed6 req-31468c9f-0306-40b6-8d7f-bf086ef37ad6 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d2400526-8c9e-4a40-8361-a5657f2d3ed6 req-31468c9f-0306-40b6-8d7f-bf086ef37ad6 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d2400526-8c9e-4a40-8361-a5657f2d3ed6 req-31468c9f-0306-40b6-8d7f-bf086ef37ad6 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d2400526-8c9e-4a40-8361-a5657f2d3ed6 req-31468c9f-0306-40b6-8d7f-bf086ef37ad6 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-d2400526-8c9e-4a40-8361-a5657f2d3ed6 req-31468c9f-0306-40b6-8d7f-bf086ef37ad6 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:35 user nova-compute[75305]: WARNING nova.compute.manager [req-d2400526-8c9e-4a40-8361-a5657f2d3ed6 req-31468c9f-0306-40b6-8d7f-bf086ef37ad6 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state active and task_state rescuing.
Nov 14 08:32:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:37 user nova-compute[75305]: WARNING nova.compute.manager [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state active and task_state rescuing.
Nov 14 08:32:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:32:37 user nova-compute[75305]: WARNING nova.compute.manager [req-37b819a6-a67e-4086-bed4-5d67df78e77a req-d315b5e8-a20e-4e2b-a709-ee6ba4977004 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state active and task_state rescuing.
Nov 14 08:32:37 user nova-compute[75305]: DEBUG nova.compute.manager [None req-9403a464-efe8-4a80-acef-6ec0442dc343 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:37 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:32:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:39 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:32:39 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.010799407958984GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance bb799710-2281-4d73-a7ef-3b8ea9b6aaaf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:32:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:32:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:32:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:32:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:32:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:32:43 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:32:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:32:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:32:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:32:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:32:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:33:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:33:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:33:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:33:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:33:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:33:37 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:33:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:33:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:33:40 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.001293182373047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance bb799710-2281-4d73-a7ef-3b8ea9b6aaaf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:33:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:33:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:33:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:33:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:33:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:33:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:33:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:33:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:33:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:33:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:33:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:33:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:33:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-changed-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Refreshing instance network info cache due to event network-changed-15534011-032b-4fa7-abb8-01c3a4339721. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] Acquiring lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] Acquired lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Refreshing network info cache for port 15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Updated VIF entry in instance network info cache for port 15534011-032b-4fa7-abb8-01c3a4339721. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:34:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Updating instance_info_cache with network_info: [{"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:34:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a7b4de28-b030-439b-9f24-524362da60e3 req-6a044c62-7c93-4d80-96d3-3a12d07584e4 service nova] Releasing lock "refresh_cache-bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:34:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:05 user nova-compute[75305]: INFO nova.compute.manager [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Terminating instance
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-6fb01bb2-c352-4e58-b43d-1496db72111e req-5e57bfae-efdf-483f-a9d5-1867ddd50013 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-vif-unplugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6fb01bb2-c352-4e58-b43d-1496db72111e req-5e57bfae-efdf-483f-a9d5-1867ddd50013 service nova] Acquiring lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6fb01bb2-c352-4e58-b43d-1496db72111e req-5e57bfae-efdf-483f-a9d5-1867ddd50013 service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6fb01bb2-c352-4e58-b43d-1496db72111e req-5e57bfae-efdf-483f-a9d5-1867ddd50013 service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-6fb01bb2-c352-4e58-b43d-1496db72111e req-5e57bfae-efdf-483f-a9d5-1867ddd50013 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] No waiting events found dispatching network-vif-unplugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.compute.manager [req-6fb01bb2-c352-4e58-b43d-1496db72111e req-5e57bfae-efdf-483f-a9d5-1867ddd50013 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-vif-unplugged-15534011-032b-4fa7-abb8-01c3a4339721 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Instance destroyed successfully.
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'resources' on Instance uuid bb799710-2281-4d73-a7ef-3b8ea9b6aaaf {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:32:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-307694048',display_name='tempest-TestVolumeBootPattern-server-307694048',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-307694048',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:32:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-yplfwmmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:32:22Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=bb799710-2281-4d73-a7ef-3b8ea9b6aaaf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "15534011-032b-4fa7-abb8-01c3a4339721", "address": "fa:16:3e:b0:9a:39", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15534011-03", "ovs_interfaceid": "15534011-032b-4fa7-abb8-01c3a4339721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9a:39,bridge_name='br-int',has_traffic_filtering=True,id=15534011-032b-4fa7-abb8-01c3a4339721,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15534011-03') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_vif [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9a:39,bridge_name='br-int',has_traffic_filtering=True,id=15534011-032b-4fa7-abb8-01c3a4339721,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15534011-03') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15534011-03, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7c5e64a-97aa-4d1d-aa86-aabbf1706105) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:34:05 user nova-compute[75305]: INFO os_vif [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:9a:39,bridge_name='br-int',has_traffic_filtering=True,id=15534011-032b-4fa7-abb8-01c3a4339721,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15534011-03')
Nov 14 08:34:05 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:34:05 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae43b5-abcd-45bf-a144-33e428e1b789]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:34:05 user nova-compute[75305]: No targets found.
Nov 14 08:34:05 user nova-compute[75305]: iSNS:
Nov 14 08:34:05 user nova-compute[75305]: No targets found.
Nov 14 08:34:05 user nova-compute[75305]: STATIC:
Nov 14 08:34:05 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9
Nov 14 08:34:05 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:34:05 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:34:05 user nova-compute[75305]: FIRMWARE:
Nov 14 08:34:05 user nova-compute[75305]: No targets found.
Nov 14 08:34:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:34:05 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:34:05 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfda423-716d-4b0e-afcb-a2647c9e2d82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[283ad6ec-caff-40ec-86ea-1f191d0bde40]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:34:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:34:05 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf541f35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c88cd-9bf9-43a5-9b28-03b7c6053c64]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae800d9a-a719-48f0-ac71-e690c6c28d10]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f699eb1b-2e74-40c9-ae73-651089a525e4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:05 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d99e7-2055-4f99-8c47-d4cd36fe83fa]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23965656230306233', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1a6f6aee', '/dev/disk/by-id/scsi-1SCST_BIO1a6f6aee-9eeb00b39534b60d') {{(pid=86224) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0eb3b1-829b-4443-8ab6-ee4ab3da303e]: (4, None) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80b4c82-3fff-4bde-a598-13e35c3ae447]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f058340-31b2-485f-818a-155dcd56f3dc]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]
Nov 14 08:34:06 user nova-compute[75305]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.
Nov 14 08:34:06 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6df4ed-1937-436a-b525-a3347ed1836e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== disconnect_volume: return (284ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:34:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Deleting instance files /opt/stack/data/nova/instances/bb799710-2281-4d73-a7ef-3b8ea9b6aaaf_del
Nov 14 08:34:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Deletion of /opt/stack/data/nova/instances/bb799710-2281-4d73-a7ef-3b8ea9b6aaaf_del complete
Nov 14 08:34:06 user nova-compute[75305]: INFO nova.compute.manager [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 08:34:06 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:34:06 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:34:07 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Took 0.90 seconds to deallocate network for instance.
Nov 14 08:34:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-8260fa4d-4ae8-4dd5-b740-e56f0708238e req-7effa346-d496-4b4d-a9e5-950ca5e67ad0 service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-vif-deleted-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-f14363a6-6a4e-4794-8ea2-b1a368acc1d7 req-9923e6c3-55a9-4830-a7f3-ece499f187ad service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received event network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f14363a6-6a4e-4794-8ea2-b1a368acc1d7 req-9923e6c3-55a9-4830-a7f3-ece499f187ad service nova] Acquiring lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f14363a6-6a4e-4794-8ea2-b1a368acc1d7 req-9923e6c3-55a9-4830-a7f3-ece499f187ad service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f14363a6-6a4e-4794-8ea2-b1a368acc1d7 req-9923e6c3-55a9-4830-a7f3-ece499f187ad service nova] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG nova.compute.manager [req-f14363a6-6a4e-4794-8ea2-b1a368acc1d7 req-9923e6c3-55a9-4830-a7f3-ece499f187ad service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] No waiting events found dispatching network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:34:07 user nova-compute[75305]: WARNING nova.compute.manager [req-f14363a6-6a4e-4794-8ea2-b1a368acc1d7 req-9923e6c3-55a9-4830-a7f3-ece499f187ad service nova] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Received unexpected event network-vif-plugged-15534011-032b-4fa7-abb8-01c3a4339721 for instance with vm_state active and task_state deleting.
Nov 14 08:34:07 user nova-compute[75305]: INFO nova.compute.manager [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: bb799710-2281-4d73-a7ef-3b8ea9b6aaaf] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 08:34:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:34:07 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:34:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:08 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Deleted allocations for instance bb799710-2281-4d73-a7ef-3b8ea9b6aaaf
Nov 14 08:34:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e16ef905-a6d9-4b23-a434-30ba0db9c554 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "bb799710-2281-4d73-a7ef-3b8ea9b6aaaf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:34:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:34:23 user nova-compute[75305]: INFO nova.compute.manager [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Unrescuing
Nov 14 08:34:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:34:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:34:23 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG nova.objects.instance [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'flavor' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-c40d201b-945c-4807-8c16-384e39b2e7f5 req-5dd3a350-e4e5-478a-a277-29153d9ac17d service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c40d201b-945c-4807-8c16-384e39b2e7f5 req-5dd3a350-e4e5-478a-a277-29153d9ac17d service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c40d201b-945c-4807-8c16-384e39b2e7f5 req-5dd3a350-e4e5-478a-a277-29153d9ac17d service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c40d201b-945c-4807-8c16-384e39b2e7f5 req-5dd3a350-e4e5-478a-a277-29153d9ac17d service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-c40d201b-945c-4807-8c16-384e39b2e7f5 req-5dd3a350-e4e5-478a-a277-29153d9ac17d service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:34:24 user nova-compute[75305]: WARNING nova.compute.manager [req-c40d201b-945c-4807-8c16-384e39b2e7f5 req-5dd3a350-e4e5-478a-a277-29153d9ac17d service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:34:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:25 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance destroyed successfully.
Nov 14 08:34:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:34:26 user nova-compute[75305]: WARNING nova.compute.manager [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:34:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG nova.compute.manager [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:34:26 user nova-compute[75305]: WARNING nova.compute.manager [req-bbf63ecf-90b3-487b-b6dd-53804f28c6a4 req-255d2932-e6d8-49df-90a5-0fabe6e33b50 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:34:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-ef2bb35d-a403-4bb9-b0a0-60b42fc04bf7 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:34:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-32fcab3b-525f-48ec-b4d8-78e889c7add5 req-e83f2891-d05e-4437-a643-0ce6070889f4 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-32fcab3b-525f-48ec-b4d8-78e889c7add5 req-e83f2891-d05e-4437-a643-0ce6070889f4 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-32fcab3b-525f-48ec-b4d8-78e889c7add5 req-e83f2891-d05e-4437-a643-0ce6070889f4 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-32fcab3b-525f-48ec-b4d8-78e889c7add5 req-e83f2891-d05e-4437-a643-0ce6070889f4 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:28 user nova-compute[75305]: DEBUG nova.compute.manager [req-32fcab3b-525f-48ec-b4d8-78e889c7add5 req-e83f2891-d05e-4437-a643-0ce6070889f4 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:34:28 user nova-compute[75305]: WARNING nova.compute.manager [req-32fcab3b-525f-48ec-b4d8-78e889c7add5 req-e83f2891-d05e-4437-a643-0ce6070889f4 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state active and task_state None.
Nov 14 08:34:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:31 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:33 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:34:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:34:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:34:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:34:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:34:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.004s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:39 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:34:39 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:34:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=25.000022888183594GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:34:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:34:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:34:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:34:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:34:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:34:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:34:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:34:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:56 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:34:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:34:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:34:56 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:34:56 user nova-compute[75305]: INFO nova.compute.claims [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Claim successful on node user
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.435s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:34:57 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.policy [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347d5cb8a22e49948b1c210d2d62ce2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a5b13c6fbb417184c70151551cd2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:34:57 user nova-compute[75305]: INFO nova.virt.block_device [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Booting with volume a8985391-61a2-4abd-90ef-0cedcdc623a9 at /dev/vda
Nov 14 08:34:57 user nova-compute[75305]: DEBUG os_brick.utils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ae45eb-108b-49b6-bb7c-52697b45b677]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed8bd33-ac9a-421e-bed8-3e76993b0531]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e703c34-d80f-47ed-a1aa-f04706d26cb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[947fad1e-c626-4f06-a4cf-71c412b9b192]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:34:57 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:34:57 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8302406-6e1e-4afb-b2c4-38d555abdc0e]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG os_brick.utils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:34:57 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updating existing volume attachment record: 8577fda2-55b5-4376-bc2a-44dc2d105da6 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Successfully created port: 4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Successfully updated port: 4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquired lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-changed-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Refreshing instance network info cache due to event network-changed-4431e6b2-7c2d-4077-a84c-7cb06c445e25. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] Acquiring lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:34:58 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updating instance_info_cache with network_info: [{"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Releasing lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Instance network_info: |[{"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] Acquired lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG nova.network.neutron [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Refreshing network info cache for port 4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG nova.network.neutron [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updated VIF entry in instance network info cache for port 4431e6b2-7c2d-4077-a84c-7cb06c445e25. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG nova.network.neutron [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updating instance_info_cache with network_info: [{"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:34:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e126209c-2033-40dc-87b9-9593dd9df8c6 req-0e00cf33-6d9d-48a0-8b78-e3f12a75cca1 service nova] Releasing lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:35:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:35:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Creating image(s)
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Ensure instance console log exists: /opt/stack/data/nova/instances/ea106c92-184a-4748-bc95-78cb23eb76b2/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Start _get_guest_xml network_info=[{"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '8577fda2-55b5-4376-bc2a-44dc2d105da6', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea106c92-184a-4748-bc95-78cb23eb76b2', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8985391-61a2-4abd-90ef-0cedcdc623a9', 'serial': 'a8985391-61a2-4abd-90ef-0cedcdc623a9'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:35:01 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:35:01 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:35:01 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:35:02 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:35:02 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:35:02 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e184f8-81d4-498a-9897-5d719ff22cb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:35:02 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c01460-74bc-400d-ab82-82fdac258941]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9] added
Nov 14 08:35:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ef655e-e6ec-46a4-a59e-e91879babd58]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e182c0b-13e0-4db7-8386-b2c4ae4fe95d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDnijVph {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDnijVph" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[80265bce-24ab-4e40-b3ff-dbf4f01ec8b9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wDnijVph'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb104d10-b026-4cb5-958c-06e00833b729]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4910a6d-5291-4251-8c10-0ef9df5ed868]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:35:02 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:35:02 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:35:02 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 08:35:02 user nova-compute[75305]: 
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92b75c-12e9-4c53-ad9c-eb5d8f061a84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]
Nov 14 08:35:02 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.
Nov 14 08:35:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8693270a-6bb6-403d-bca8-0a7f8f0b5ecd]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4846833b-b7aa-4e06-8887-20153352d8d5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:35:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:35:02 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f03ae0-9fa5-45fe-833f-d861c7bab294]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:35:02 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23965656230306233', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965656230306233', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1174198352',display_name='tempest-TestVolumeBootPattern-server-1174198352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1174198352',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-07rlb30f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:34:57Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=ea106c92-184a-4748-bc95-78cb23eb76b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:59:49,bridge_name='br-int',has_traffic_filtering=True,id=4431e6b2-7c2d-4077-a84c-7cb06c445e25,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4431e6b2-7c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'pci_devices' on Instance uuid ea106c92-184a-4748-bc95-78cb23eb76b2 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:35:03 user nova-compute[75305]:   <uuid>ea106c92-184a-4748-bc95-78cb23eb76b2</uuid>
Nov 14 08:35:03 user nova-compute[75305]:   <name>instance-00000030</name>
Nov 14 08:35:03 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:35:03 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:35:03 user nova-compute[75305]:   <metadata>
Nov 14 08:35:03 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:35:03 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:35:03 user nova-compute[75305]:       <nova:name>tempest-TestVolumeBootPattern-server-1174198352</nova:name>
Nov 14 08:35:03 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:35:01</nova:creationTime>
Nov 14 08:35:03 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:35:03 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:35:03 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:35:03 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:35:03 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:35:03 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:35:03 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:35:03 user nova-compute[75305]:       <nova:owner>
Nov 14 08:35:03 user nova-compute[75305]:         <nova:user uuid="347d5cb8a22e49948b1c210d2d62ce2b">tempest-TestVolumeBootPattern-1297430060-project-member</nova:user>
Nov 14 08:35:03 user nova-compute[75305]:         <nova:project uuid="37a5b13c6fbb417184c70151551cd2a4">tempest-TestVolumeBootPattern-1297430060</nova:project>
Nov 14 08:35:03 user nova-compute[75305]:       </nova:owner>
Nov 14 08:35:03 user nova-compute[75305]:       <nova:ports>
Nov 14 08:35:03 user nova-compute[75305]:         <nova:port uuid="4431e6b2-7c2d-4077-a84c-7cb06c445e25">
Nov 14 08:35:03 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 08:35:03 user nova-compute[75305]:         </nova:port>
Nov 14 08:35:03 user nova-compute[75305]:       </nova:ports>
Nov 14 08:35:03 user nova-compute[75305]:     </nova:instance>
Nov 14 08:35:03 user nova-compute[75305]:   </metadata>
Nov 14 08:35:03 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:35:03 user nova-compute[75305]:     <system>
Nov 14 08:35:03 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:35:03 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:35:03 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:35:03 user nova-compute[75305]:       <entry name="serial">ea106c92-184a-4748-bc95-78cb23eb76b2</entry>
Nov 14 08:35:03 user nova-compute[75305]:       <entry name="uuid">ea106c92-184a-4748-bc95-78cb23eb76b2</entry>
Nov 14 08:35:03 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:35:03 user nova-compute[75305]:     </system>
Nov 14 08:35:03 user nova-compute[75305]:   </sysinfo>
Nov 14 08:35:03 user nova-compute[75305]:   <os>
Nov 14 08:35:03 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:35:03 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:35:03 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:35:03 user nova-compute[75305]:   </os>
Nov 14 08:35:03 user nova-compute[75305]:   <features>
Nov 14 08:35:03 user nova-compute[75305]:     <acpi/>
Nov 14 08:35:03 user nova-compute[75305]:     <apic/>
Nov 14 08:35:03 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:35:03 user nova-compute[75305]:   </features>
Nov 14 08:35:03 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:35:03 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:35:03 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:35:03 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:35:03 user nova-compute[75305]:   </clock>
Nov 14 08:35:03 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:35:03 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:35:03 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:35:03 user nova-compute[75305]:   </cpu>
Nov 14 08:35:03 user nova-compute[75305]:   <devices>
Nov 14 08:35:03 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:35:03 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:35:03 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:35:03 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:35:03 user nova-compute[75305]:       <serial>a8985391-61a2-4abd-90ef-0cedcdc623a9</serial>
Nov 14 08:35:03 user nova-compute[75305]:     </disk>
Nov 14 08:35:03 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:35:03 user nova-compute[75305]:       <mac address="fa:16:3e:ad:59:49"/>
Nov 14 08:35:03 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:35:03 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:35:03 user nova-compute[75305]:       <target dev="tap4431e6b2-7c"/>
Nov 14 08:35:03 user nova-compute[75305]:     </interface>
Nov 14 08:35:03 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:35:03 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ea106c92-184a-4748-bc95-78cb23eb76b2/console.log" append="off"/>
Nov 14 08:35:03 user nova-compute[75305]:     </serial>
Nov 14 08:35:03 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:35:03 user nova-compute[75305]:     <video>
Nov 14 08:35:03 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:35:03 user nova-compute[75305]:     </video>
Nov 14 08:35:03 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:35:03 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:35:03 user nova-compute[75305]:     </rng>
Nov 14 08:35:03 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:35:03 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:35:03 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:35:03 user nova-compute[75305]:     </memballoon>
Nov 14 08:35:03 user nova-compute[75305]:   </devices>
Nov 14 08:35:03 user nova-compute[75305]: </domain>
Nov 14 08:35:03 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1174198352',display_name='tempest-TestVolumeBootPattern-server-1174198352',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1174198352',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-07rlb30f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:34:57Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=ea106c92-184a-4748-bc95-78cb23eb76b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:59:49,bridge_name='br-int',has_traffic_filtering=True,id=4431e6b2-7c2d-4077-a84c-7cb06c445e25,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4431e6b2-7c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG os_vif [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:59:49,bridge_name='br-int',has_traffic_filtering=True,id=4431e6b2-7c2d-4077-a84c-7cb06c445e25,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4431e6b2-7c') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1b918fe-3549-586c-8e38-a4cf694d5169', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4431e6b2-7c, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4431e6b2-7c, col_values=(('qos', UUID('2d98c1dd-69f8-4e0c-a424-606696074c19')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4431e6b2-7c, col_values=(('external_ids', {'iface-id': '4431e6b2-7c2d-4077-a84c-7cb06c445e25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:59:49', 'vm-uuid': 'ea106c92-184a-4748-bc95-78cb23eb76b2'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:03 user nova-compute[75305]: INFO os_vif [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:59:49,bridge_name='br-int',has_traffic_filtering=True,id=4431e6b2-7c2d-4077-a84c-7cb06c445e25,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4431e6b2-7c')
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:35:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No VIF found with MAC fa:16:3e:ad:59:49, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-ad40920d-b56d-4b19-b1de-260a0fde8b31 req-d3e34732-aaa9-43ca-8ac2-8601677e9787 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ad40920d-b56d-4b19-b1de-260a0fde8b31 req-d3e34732-aaa9-43ca-8ac2-8601677e9787 service nova] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ad40920d-b56d-4b19-b1de-260a0fde8b31 req-d3e34732-aaa9-43ca-8ac2-8601677e9787 service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ad40920d-b56d-4b19-b1de-260a0fde8b31 req-d3e34732-aaa9-43ca-8ac2-8601677e9787 service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:35:04 user nova-compute[75305]: DEBUG nova.compute.manager [req-ad40920d-b56d-4b19-b1de-260a0fde8b31 req-d3e34732-aaa9-43ca-8ac2-8601677e9787 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] No waiting events found dispatching network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:35:04 user nova-compute[75305]: WARNING nova.compute.manager [req-ad40920d-b56d-4b19-b1de-260a0fde8b31 req-d3e34732-aaa9-43ca-8ac2-8601677e9787 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received unexpected event network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 for instance with vm_state building and task_state spawning.
Nov 14 08:35:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:35:06 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Instance spawned successfully.
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:35:06 user nova-compute[75305]: INFO nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:35:06 user nova-compute[75305]: INFO nova.compute.manager [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Took 10.11 seconds to build instance.
Nov 14 08:35:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e7ea2e69-29b5-473e-b79f-ca1012b9e1e5 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.194s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-1e40d2aa-d2f2-4161-81b6-10f1bbcbae53 req-76a9f772-51ad-4078-a1ca-26aa2d3136ac service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1e40d2aa-d2f2-4161-81b6-10f1bbcbae53 req-76a9f772-51ad-4078-a1ca-26aa2d3136ac service nova] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1e40d2aa-d2f2-4161-81b6-10f1bbcbae53 req-76a9f772-51ad-4078-a1ca-26aa2d3136ac service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1e40d2aa-d2f2-4161-81b6-10f1bbcbae53 req-76a9f772-51ad-4078-a1ca-26aa2d3136ac service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:35:06 user nova-compute[75305]: DEBUG nova.compute.manager [req-1e40d2aa-d2f2-4161-81b6-10f1bbcbae53 req-76a9f772-51ad-4078-a1ca-26aa2d3136ac service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] No waiting events found dispatching network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:35:06 user nova-compute[75305]: WARNING nova.compute.manager [req-1e40d2aa-d2f2-4161-81b6-10f1bbcbae53 req-76a9f772-51ad-4078-a1ca-26aa2d3136ac service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received unexpected event network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 for instance with vm_state active and task_state None.
Nov 14 08:35:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:35:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:32 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:35 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:35:39 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:35:39 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:35:39 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8755MB free_disk=24.998062133789062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:35:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea106c92-184a-4748-bc95-78cb23eb76b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:35:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:35:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:35:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:35:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:35:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:35:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:35:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:35:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:35:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:36:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:36:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:36:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:36:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:36:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:36:18 user nova-compute[75305]: INFO nova.compute.claims [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Claim successful on node user
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:36:18 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:36:18 user nova-compute[75305]: DEBUG nova.policy [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd9bee7b3e5f0483d94a46fbed06604c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7369e5af19a940d69cec15ce79234459', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:36:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Creating image(s)
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk 1073741824" returned: 0 in 0.047s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Cannot resize image /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Ensure instance console log exists: /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:19 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Successfully created port: 0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Successfully updated port: 0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing instance network info cache due to event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.neutron [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance network_info: |[{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.neutron [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Start _get_guest_xml network_info=[{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:36:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:36:20 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442171780',display_name='tempest-ServerRescueNegativeTestJSON-server-1442171780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442171780',id=49,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsSCgXyTHC7dTAO20YwecW8PWu30xQRS8tZIbS9y9/elJHpeorq8PHX7nq7smJLg3JLUjRMcByb2mKG+n/vg1ZJB+NZ+yl3AHXhjBtKvBORlOt9sdz3kntkGdDeadumrQ==',key_name='tempest-keypair-803852582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-tc4uswe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=2f193a71-608f-4406-ae3b-b3b5e36e9674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:36:20 user nova-compute[75305]:   <uuid>2f193a71-608f-4406-ae3b-b3b5e36e9674</uuid>
Nov 14 08:36:20 user nova-compute[75305]:   <name>instance-00000031</name>
Nov 14 08:36:20 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:36:20 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:36:20 user nova-compute[75305]:   <metadata>
Nov 14 08:36:20 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:36:20 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:36:20 user nova-compute[75305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1442171780</nova:name>
Nov 14 08:36:20 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:36:20</nova:creationTime>
Nov 14 08:36:20 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:36:20 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:36:20 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:36:20 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:36:20 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:36:20 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:36:20 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:36:20 user nova-compute[75305]:       <nova:owner>
Nov 14 08:36:20 user nova-compute[75305]:         <nova:user uuid="d9bee7b3e5f0483d94a46fbed06604c5">tempest-ServerRescueNegativeTestJSON-300947473-project-member</nova:user>
Nov 14 08:36:20 user nova-compute[75305]:         <nova:project uuid="7369e5af19a940d69cec15ce79234459">tempest-ServerRescueNegativeTestJSON-300947473</nova:project>
Nov 14 08:36:20 user nova-compute[75305]:       </nova:owner>
Nov 14 08:36:20 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:36:20 user nova-compute[75305]:       <nova:ports>
Nov 14 08:36:20 user nova-compute[75305]:         <nova:port uuid="0478e8a7-3488-42ac-acb2-2a110d5997ff">
Nov 14 08:36:20 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:36:20 user nova-compute[75305]:         </nova:port>
Nov 14 08:36:20 user nova-compute[75305]:       </nova:ports>
Nov 14 08:36:20 user nova-compute[75305]:     </nova:instance>
Nov 14 08:36:20 user nova-compute[75305]:   </metadata>
Nov 14 08:36:20 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:36:20 user nova-compute[75305]:     <system>
Nov 14 08:36:20 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:36:20 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:36:20 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:36:20 user nova-compute[75305]:       <entry name="serial">2f193a71-608f-4406-ae3b-b3b5e36e9674</entry>
Nov 14 08:36:20 user nova-compute[75305]:       <entry name="uuid">2f193a71-608f-4406-ae3b-b3b5e36e9674</entry>
Nov 14 08:36:20 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:36:20 user nova-compute[75305]:     </system>
Nov 14 08:36:20 user nova-compute[75305]:   </sysinfo>
Nov 14 08:36:20 user nova-compute[75305]:   <os>
Nov 14 08:36:20 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:36:20 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:36:20 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:36:20 user nova-compute[75305]:   </os>
Nov 14 08:36:20 user nova-compute[75305]:   <features>
Nov 14 08:36:20 user nova-compute[75305]:     <acpi/>
Nov 14 08:36:20 user nova-compute[75305]:     <apic/>
Nov 14 08:36:20 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:36:20 user nova-compute[75305]:   </features>
Nov 14 08:36:20 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:36:20 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:36:20 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:36:20 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:36:20 user nova-compute[75305]:   </clock>
Nov 14 08:36:20 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:36:20 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:36:20 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:36:20 user nova-compute[75305]:   </cpu>
Nov 14 08:36:20 user nova-compute[75305]:   <devices>
Nov 14 08:36:20 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:36:20 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:36:20 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk"/>
Nov 14 08:36:20 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:36:20 user nova-compute[75305]:     </disk>
Nov 14 08:36:20 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:36:20 user nova-compute[75305]:       <mac address="fa:16:3e:6e:37:8d"/>
Nov 14 08:36:20 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:36:20 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:36:20 user nova-compute[75305]:       <target dev="tap0478e8a7-34"/>
Nov 14 08:36:20 user nova-compute[75305]:     </interface>
Nov 14 08:36:20 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:36:20 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/console.log" append="off"/>
Nov 14 08:36:20 user nova-compute[75305]:     </serial>
Nov 14 08:36:20 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:36:20 user nova-compute[75305]:     <video>
Nov 14 08:36:20 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:36:20 user nova-compute[75305]:     </video>
Nov 14 08:36:20 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:36:20 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:36:20 user nova-compute[75305]:     </rng>
Nov 14 08:36:20 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:36:20 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:36:20 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:36:20 user nova-compute[75305]:     </memballoon>
Nov 14 08:36:20 user nova-compute[75305]:   </devices>
Nov 14 08:36:20 user nova-compute[75305]: </domain>
Nov 14 08:36:20 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442171780',display_name='tempest-ServerRescueNegativeTestJSON-server-1442171780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442171780',id=49,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsSCgXyTHC7dTAO20YwecW8PWu30xQRS8tZIbS9y9/elJHpeorq8PHX7nq7smJLg3JLUjRMcByb2mKG+n/vg1ZJB+NZ+yl3AHXhjBtKvBORlOt9sdz3kntkGdDeadumrQ==',key_name='tempest-keypair-803852582',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-tc4uswe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:36:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=2f193a71-608f-4406-ae3b-b3b5e36e9674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG os_vif [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83f74aa1-097a-5934-8f64-35edbfc3b85c', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0478e8a7-34, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0478e8a7-34, col_values=(('qos', UUID('3f307aa8-314b-4d20-b015-90bec27d5a76')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0478e8a7-34, col_values=(('external_ids', {'iface-id': '0478e8a7-3488-42ac-acb2-2a110d5997ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:37:8d', 'vm-uuid': '2f193a71-608f-4406-ae3b-b3b5e36e9674'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:36:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:20 user nova-compute[75305]: INFO os_vif [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34')
Nov 14 08:36:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:36:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No VIF found with MAC fa:16:3e:6e:37:8d, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:36:21 user nova-compute[75305]: DEBUG nova.network.neutron [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updated VIF entry in instance network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:36:21 user nova-compute[75305]: DEBUG nova.network.neutron [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:36:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9042d89f-5e88-437a-88fa-843e42154d34 req-ee5e8036-a339-4742-ab91-4f39e2663c12 service nova] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-bee7328e-1836-487f-82f0-0f577af28cda req-05829fbd-cb6d-47a5-96d8-180f782b1f08 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bee7328e-1836-487f-82f0-0f577af28cda req-05829fbd-cb6d-47a5-96d8-180f782b1f08 service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bee7328e-1836-487f-82f0-0f577af28cda req-05829fbd-cb6d-47a5-96d8-180f782b1f08 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bee7328e-1836-487f-82f0-0f577af28cda req-05829fbd-cb6d-47a5-96d8-180f782b1f08 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:22 user nova-compute[75305]: DEBUG nova.compute.manager [req-bee7328e-1836-487f-82f0-0f577af28cda req-05829fbd-cb6d-47a5-96d8-180f782b1f08 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:36:22 user nova-compute[75305]: WARNING nova.compute.manager [req-bee7328e-1836-487f-82f0-0f577af28cda req-05829fbd-cb6d-47a5-96d8-180f782b1f08 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state building and task_state spawning.
Nov 14 08:36:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:36:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance spawned successfully.
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:36:24 user nova-compute[75305]: INFO nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:36:24 user nova-compute[75305]: INFO nova.compute.manager [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Took 6.15 seconds to build instance.
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-e82d80ae-8d67-4f79-9d72-712e137088d9 req-1b5c226a-264d-47bc-8cb9-314ddc03bfa4 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e82d80ae-8d67-4f79-9d72-712e137088d9 req-1b5c226a-264d-47bc-8cb9-314ddc03bfa4 service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e82d80ae-8d67-4f79-9d72-712e137088d9 req-1b5c226a-264d-47bc-8cb9-314ddc03bfa4 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e82d80ae-8d67-4f79-9d72-712e137088d9 req-1b5c226a-264d-47bc-8cb9-314ddc03bfa4 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:24 user nova-compute[75305]: DEBUG nova.compute.manager [req-e82d80ae-8d67-4f79-9d72-712e137088d9 req-1b5c226a-264d-47bc-8cb9-314ddc03bfa4 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:36:24 user nova-compute[75305]: WARNING nova.compute.manager [req-e82d80ae-8d67-4f79-9d72-712e137088d9 req-1b5c226a-264d-47bc-8cb9-314ddc03bfa4 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state active and task_state None.
Nov 14 08:36:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a23bcf0f-5b50-4ba4-8e29-822b6893469d tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.264s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:36:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:36:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:36:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:36:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:36:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:36:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:39 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:42 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:36:42 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8629MB free_disk=24.970130920410156GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea106c92-184a-4748-bc95-78cb23eb76b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:36:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:36:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-changed-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG nova.compute.manager [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Refreshing instance network info cache due to event network-changed-4431e6b2-7c2d-4077-a84c-7cb06c445e25. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] Acquiring lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] Acquired lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG nova.network.neutron [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Refreshing network info cache for port 4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG nova.network.neutron [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updated VIF entry in instance network info cache for port 4431e6b2-7c2d-4077-a84c-7cb06c445e25. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG nova.network.neutron [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updating instance_info_cache with network_info: [{"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:36:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d12af192-2b72-48f6-a94c-fa2ff70da3bd req-3f434a1f-d2b8-44ec-aadb-82e4d4bd3d85 service nova] Releasing lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:36:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:36:53 user nova-compute[75305]: INFO nova.compute.claims [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Claim successful on node user
Nov 14 08:36:53 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.321s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:36:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:36:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG nova.policy [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '347d5cb8a22e49948b1c210d2d62ce2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a5b13c6fbb417184c70151551cd2a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:36:54 user nova-compute[75305]: INFO nova.virt.block_device [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Booting with volume 51d24c97-2514-4d2c-bccd-10c549fe3d4e at /dev/vda
Nov 14 08:36:54 user nova-compute[75305]: DEBUG os_brick.utils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6777139d-5951-46ef-adca-bc8c067bb9e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a0ed70-7424-4bcd-a693-90641b3a06ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9d25bd-6db4-46e2-9000-b6c82c565a18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[725d8a56-4f68-46d0-a1ba-6c41d8020761]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:36:54 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:36:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fc82df-1a7b-4009-9143-19b68d9ecca0]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG os_brick.utils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updating existing volume attachment record: 3525e324-5a78-43c5-a8e2-3e8ff89e5d1f {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:36:54 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Successfully created port: 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Successfully updated port: 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquired lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-changed-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.compute.manager [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Refreshing instance network info cache due to event network-changed-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] Acquiring lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updating instance_info_cache with network_info: [{"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Releasing lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Instance network_info: |[{"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] Acquired lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:36:55 user nova-compute[75305]: DEBUG nova.network.neutron [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Refreshing network info cache for port 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:36:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updated VIF entry in instance network info cache for port 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:36:56 user nova-compute[75305]: DEBUG nova.network.neutron [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updating instance_info_cache with network_info: [{"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:36:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:36:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5c154d6e-b4e6-4037-a852-b7730ddeab4b req-21cdfe61-a80e-4478-b14a-5540febc3c19 service nova] Releasing lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:36:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Creating image(s)
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Did not create local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Ensure instance console log exists: /opt/stack/data/nova/instances/52b5db0e-1eae-40ff-b48d-2b7614fdb463/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Start _get_guest_xml network_info=[{"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3525e324-5a78-43c5-a8e2-3e8ff89e5d1f', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEbdALQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '52b5db0e-1eae-40ff-b48d-2b7614fdb463', 'attached_at': '', 'detached_at': '', 'volume_id': '51d24c97-2514-4d2c-bccd-10c549fe3d4e', 'serial': '51d24c97-2514-4d2c-bccd-10c549fe3d4e'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:36:58 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:36:58 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEbdALQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:36:58 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:36:58 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:36:58 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e795d89c-cb51-4d5f-bdf6-e396c06f241c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:36:58 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6eeab1-52d4-4ab4-9da0-48885bd90392]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e] added
Nov 14 08:36:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6699f2-ac17-4d22-8520-d3a169502375]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf9218-5f9d-40ed-aa40-eda841d6cc69]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEbdALQZ {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yEbdALQZ" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4b5c42-3b33-49f3-aed3-0642c9eeaa0a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yEbdALQZ'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf2dbe8-b508-40b1-910d-50c439ea86d5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2ff4fc-fc0f-4278-aa54-a46f5dbd9990]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:36:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:36:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[613be292-82d0-49dd-934e-8e4fd5e26605]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260]
Nov 14 08:36:58 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260] successful.
Nov 14 08:36:58 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2b433f-dd63-4b4f-879d-124fb002797f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:36:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4338e6c2-5248-4a3a-a37a-4d131f701376]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:36:59 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:36:59 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:36:59 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:36:59 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01c3191-e3ce-4c8c-b547-faa3ad4859f4]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEbdALQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:36:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26636393264623436', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636393264623436', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1925100689',display_name='tempest-TestVolumeBootPattern-server-1925100689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1925100689',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-vadu3nr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:36:54Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=52b5db0e-1eae-40ff-b48d-2b7614fdb463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:3d:2c,bridge_name='br-int',has_traffic_filtering=True,id=009ff1fe-6395-4fa4-ae6d-d6b01d1289d8,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009ff1fe-63') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b5db0e-1eae-40ff-b48d-2b7614fdb463 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:37:00 user nova-compute[75305]:   <uuid>52b5db0e-1eae-40ff-b48d-2b7614fdb463</uuid>
Nov 14 08:37:00 user nova-compute[75305]:   <name>instance-00000032</name>
Nov 14 08:37:00 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:37:00 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:37:00 user nova-compute[75305]:   <metadata>
Nov 14 08:37:00 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:37:00 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:37:00 user nova-compute[75305]:       <nova:name>tempest-TestVolumeBootPattern-server-1925100689</nova:name>
Nov 14 08:37:00 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:36:58</nova:creationTime>
Nov 14 08:37:00 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:37:00 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:37:00 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:37:00 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:37:00 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:37:00 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:37:00 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:37:00 user nova-compute[75305]:       <nova:owner>
Nov 14 08:37:00 user nova-compute[75305]:         <nova:user uuid="347d5cb8a22e49948b1c210d2d62ce2b">tempest-TestVolumeBootPattern-1297430060-project-member</nova:user>
Nov 14 08:37:00 user nova-compute[75305]:         <nova:project uuid="37a5b13c6fbb417184c70151551cd2a4">tempest-TestVolumeBootPattern-1297430060</nova:project>
Nov 14 08:37:00 user nova-compute[75305]:       </nova:owner>
Nov 14 08:37:00 user nova-compute[75305]:       <nova:ports>
Nov 14 08:37:00 user nova-compute[75305]:         <nova:port uuid="009ff1fe-6395-4fa4-ae6d-d6b01d1289d8">
Nov 14 08:37:00 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 08:37:00 user nova-compute[75305]:         </nova:port>
Nov 14 08:37:00 user nova-compute[75305]:       </nova:ports>
Nov 14 08:37:00 user nova-compute[75305]:     </nova:instance>
Nov 14 08:37:00 user nova-compute[75305]:   </metadata>
Nov 14 08:37:00 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:37:00 user nova-compute[75305]:     <system>
Nov 14 08:37:00 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:37:00 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:37:00 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:37:00 user nova-compute[75305]:       <entry name="serial">52b5db0e-1eae-40ff-b48d-2b7614fdb463</entry>
Nov 14 08:37:00 user nova-compute[75305]:       <entry name="uuid">52b5db0e-1eae-40ff-b48d-2b7614fdb463</entry>
Nov 14 08:37:00 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:37:00 user nova-compute[75305]:     </system>
Nov 14 08:37:00 user nova-compute[75305]:   </sysinfo>
Nov 14 08:37:00 user nova-compute[75305]:   <os>
Nov 14 08:37:00 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:37:00 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:37:00 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:37:00 user nova-compute[75305]:   </os>
Nov 14 08:37:00 user nova-compute[75305]:   <features>
Nov 14 08:37:00 user nova-compute[75305]:     <acpi/>
Nov 14 08:37:00 user nova-compute[75305]:     <apic/>
Nov 14 08:37:00 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:37:00 user nova-compute[75305]:   </features>
Nov 14 08:37:00 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:37:00 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:37:00 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:37:00 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:37:00 user nova-compute[75305]:   </clock>
Nov 14 08:37:00 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:37:00 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:37:00 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:37:00 user nova-compute[75305]:   </cpu>
Nov 14 08:37:00 user nova-compute[75305]:   <devices>
Nov 14 08:37:00 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:37:00 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:37:00 user nova-compute[75305]:       <source dev="/dev/sdc"/>
Nov 14 08:37:00 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:37:00 user nova-compute[75305]:       <serial>51d24c97-2514-4d2c-bccd-10c549fe3d4e</serial>
Nov 14 08:37:00 user nova-compute[75305]:     </disk>
Nov 14 08:37:00 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:37:00 user nova-compute[75305]:       <mac address="fa:16:3e:39:3d:2c"/>
Nov 14 08:37:00 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:37:00 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:37:00 user nova-compute[75305]:       <target dev="tap009ff1fe-63"/>
Nov 14 08:37:00 user nova-compute[75305]:     </interface>
Nov 14 08:37:00 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:37:00 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/52b5db0e-1eae-40ff-b48d-2b7614fdb463/console.log" append="off"/>
Nov 14 08:37:00 user nova-compute[75305]:     </serial>
Nov 14 08:37:00 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:37:00 user nova-compute[75305]:     <video>
Nov 14 08:37:00 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:37:00 user nova-compute[75305]:     </video>
Nov 14 08:37:00 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:37:00 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:37:00 user nova-compute[75305]:     </rng>
Nov 14 08:37:00 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:37:00 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:37:00 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:37:00 user nova-compute[75305]:     </memballoon>
Nov 14 08:37:00 user nova-compute[75305]:   </devices>
Nov 14 08:37:00 user nova-compute[75305]: </domain>
Nov 14 08:37:00 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1925100689',display_name='tempest-TestVolumeBootPattern-server-1925100689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1925100689',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-vadu3nr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:36:54Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=52b5db0e-1eae-40ff-b48d-2b7614fdb463,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:3d:2c,bridge_name='br-int',has_traffic_filtering=True,id=009ff1fe-6395-4fa4-ae6d-d6b01d1289d8,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009ff1fe-63') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG os_vif [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:3d:2c,bridge_name='br-int',has_traffic_filtering=True,id=009ff1fe-6395-4fa4-ae6d-d6b01d1289d8,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009ff1fe-63') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd84a2a26-cafa-5013-8f05-0b9047d81364', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap009ff1fe-63, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap009ff1fe-63, col_values=(('qos', UUID('03d42d7f-24a1-4344-8768-05331d8f975e')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap009ff1fe-63, col_values=(('external_ids', {'iface-id': '009ff1fe-6395-4fa4-ae6d-d6b01d1289d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:3d:2c', 'vm-uuid': '52b5db0e-1eae-40ff-b48d-2b7614fdb463'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:00 user nova-compute[75305]: INFO os_vif [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:3d:2c,bridge_name='br-int',has_traffic_filtering=True,id=009ff1fe-6395-4fa4-ae6d-d6b01d1289d8,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009ff1fe-63')
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:37:00 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] No VIF found with MAC fa:16:3e:39:3d:2c, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-d303f7d9-4e0b-487b-a282-fff6f0605891 req-69028884-35c0-446e-bb6c-5c827260ca80 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d303f7d9-4e0b-487b-a282-fff6f0605891 req-69028884-35c0-446e-bb6c-5c827260ca80 service nova] Acquiring lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d303f7d9-4e0b-487b-a282-fff6f0605891 req-69028884-35c0-446e-bb6c-5c827260ca80 service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d303f7d9-4e0b-487b-a282-fff6f0605891 req-69028884-35c0-446e-bb6c-5c827260ca80 service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:37:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-d303f7d9-4e0b-487b-a282-fff6f0605891 req-69028884-35c0-446e-bb6c-5c827260ca80 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] No waiting events found dispatching network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:37:01 user nova-compute[75305]: WARNING nova.compute.manager [req-d303f7d9-4e0b-487b-a282-fff6f0605891 req-69028884-35c0-446e-bb6c-5c827260ca80 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received unexpected event network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 for instance with vm_state building and task_state spawning.
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:37:03 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Instance spawned successfully.
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:37:03 user nova-compute[75305]: INFO nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Took 4.78 seconds to spawn the instance on the hypervisor.
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:37:03 user nova-compute[75305]: INFO nova.compute.manager [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Took 9.93 seconds to build instance.
Nov 14 08:37:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4bb4de98-299e-4586-98a8-4456e8a1db99 tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.025s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-466dc44a-1d2c-45ee-be20-752193962dcf req-79469531-6c2e-407a-b5a2-d5cf98f5aeb5 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-466dc44a-1d2c-45ee-be20-752193962dcf req-79469531-6c2e-407a-b5a2-d5cf98f5aeb5 service nova] Acquiring lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-466dc44a-1d2c-45ee-be20-752193962dcf req-79469531-6c2e-407a-b5a2-d5cf98f5aeb5 service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-466dc44a-1d2c-45ee-be20-752193962dcf req-79469531-6c2e-407a-b5a2-d5cf98f5aeb5 service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:37:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-466dc44a-1d2c-45ee-be20-752193962dcf req-79469531-6c2e-407a-b5a2-d5cf98f5aeb5 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] No waiting events found dispatching network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:37:03 user nova-compute[75305]: WARNING nova.compute.manager [req-466dc44a-1d2c-45ee-be20-752193962dcf req-79469531-6c2e-407a-b5a2-d5cf98f5aeb5 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received unexpected event network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 for instance with vm_state active and task_state None.
Nov 14 08:37:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:33 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:36 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:40 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:37:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:37:42 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:37:42 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8541MB free_disk=24.966487884521484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea106c92-184a-4748-bc95-78cb23eb76b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 52b5db0e-1eae-40ff-b48d-2b7614fdb463 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:37:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:37:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:46 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:37:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:37:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:37:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:37:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:37:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:37:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:37:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:38:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:38:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:38:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:38:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Verify base images {{(pid=75305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Image id 5d88aadf-7386-48ab-8524-9b99a75f107c yields fingerprint bd3fa4d08ab761532beb94b8c542750390b65b48 {{(pid=75305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] image 5d88aadf-7386-48ab-8524-9b99a75f107c at (/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48): checking
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] image 5d88aadf-7386-48ab-8524-9b99a75f107c at (/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48): image is in use {{(pid=75305) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] fbf25e85-e17d-4b6b-8a48-40a6009bf129 is a valid instance name {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] fbf25e85-e17d-4b6b-8a48-40a6009bf129 has a disk file {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 is backed by bd3fa4d08ab761532beb94b8c542750390b65b48 {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] 41effa45-fafa-4575-9f95-f0c43849929a is a valid instance name {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] 41effa45-fafa-4575-9f95-f0c43849929a has a disk file {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a is backed by bd3fa4d08ab761532beb94b8c542750390b65b48 {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] 52b5db0e-1eae-40ff-b48d-2b7614fdb463 is a valid instance name {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] 2f193a71-608f-4406-ae3b-b3b5e36e9674 is a valid instance name {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] 2f193a71-608f-4406-ae3b-b3b5e36e9674 has a disk file {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 is backed by bd3fa4d08ab761532beb94b8c542750390b65b48 {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] ea106c92-184a-4748-bc95-78cb23eb76b2 is a valid instance name {{(pid=75305) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8
Nov 14 08:38:06 user nova-compute[75305]: WARNING nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Active base files: /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Removable base files: /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9 /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72 /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6 /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8 /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5 /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848 /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934 /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8 /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27b61cca05f8617752fc4396e41b23b8277660c9
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ac5a8080616dc1b4c048b54e43f6f7c2b5391d72
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1c2393b0eda040c3bbcefcec18c22b3dea826fa6
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a32e9b9f50328ac47f4989a65b3380fde82e68a8
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d33d36be252222f277e5d68e7234354a0f550ed5
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbaf45db8b1c9b3927aeb14612dafa77722ae848
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/04ad65805c7fa3332142c7ffa42d57bd23622934
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ece714b799b124c9c04b245de5f605f96c509bf8
Nov 14 08:38:06 user nova-compute[75305]: INFO nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bd7b8e68574a4b7ea9109d94d1cdb8fead317638
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Verification complete {{(pid=75305) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Verify swap images {{(pid=75305) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 08:38:06 user nova-compute[75305]: DEBUG nova.virt.libvirt.imagecache [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Verify ephemeral images {{(pid=75305) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 08:38:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing instance network info cache due to event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:38:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:38:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:38:09 user nova-compute[75305]: DEBUG nova.network.neutron [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:38:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:38:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updated VIF entry in instance network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:38:10 user nova-compute[75305]: DEBUG nova.network.neutron [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:38:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4893860a-dba0-4b13-ab29-cd3653d7a44a req-1ec683d6-d3ae-4774-9710-b0ce7a24f1a6 service nova] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'flavor' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:11 user nova-compute[75305]: INFO nova.compute.manager [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Attaching volume 85baf342-0709-4c2a-b103-13c8294417a0 to /dev/vdb
Nov 14 08:38:11 user nova-compute[75305]: DEBUG os_brick.utils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d2876a-50ac-4387-a32c-465f0bf7f0d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0904f0e-9be0-418c-991b-036ff579389c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afad9b32-97bc-4582-9446-4f23f3318e5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b38f36a-a595-477a-b464-f60c85f101c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:38:11 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:38:11 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1536e3dc-6384-456e-a9e6-3d5a46b8913e]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG os_brick.utils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:38:11 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating existing volume attachment record: f1e03939-9af1-4dcc-963b-e235fad95066 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:38:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enGNXWHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:38:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:38:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:38:15 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac2540-631d-4f62-bb99-b2f2566094b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:38:15 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c23ccd-304c-4ae8-a3b7-c78cd4a9add4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0] added
Nov 14 08:38:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e2ee30-652f-44ac-9829-9f74dda681a2]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcef4ce-4b34-48ae-b995-1adc174b43ae]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enGNXWHF {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enGNXWHF" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479bbe6-3279-4e65-9a4b-c1a006ec30c9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'enGNXWHF'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4121184f-5f12-40a5-88c1-6ab0c6a1789c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05125372-ade4-40eb-9a24-c0aca5fe284f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:38:15 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:38:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:38:15 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:38:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c0ef97-b1c8-442a-ac1e-2fc0564ac773]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260]
Nov 14 08:38:15 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260] successful.
Nov 14 08:38:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf47e1e0-58d0-4349-87d6-9c360af64f57]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e905fdd6-1954-41c8-be0c-e9a314773e20]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:38:15 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:38:15 user nova-compute[75305]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:38:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:38:15 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:38:15 user nova-compute[75305]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:38:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:38:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c0ba5-b38f-4624-95a1-ee85cb3336c8]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:38:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enGNXWHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23866373138386361', 'path': '/dev/sdd'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866373138386361', 'path': '/dev/sdd'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'flavor' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:38:17 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:38:17 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:38:17 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:38:17 user nova-compute[75305]:   <serial>85baf342-0709-4c2a-b103-13c8294417a0</serial>
Nov 14 08:38:17 user nova-compute[75305]: </disk>
Nov 14 08:38:17 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No VIF found with MAC fa:16:3e:6e:37:8d, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:38:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c07cbba0-f0e4-4b5c-a7c2-7b0f19b9d4a0 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.224s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:18 user nova-compute[75305]: INFO nova.compute.manager [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Rescuing
Nov 14 08:38:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG nova.network.neutron [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-99234be1-4de3-4566-937d-6959ae4ba96c req-ea3c0fae-138b-4a72-9301-53142564db65 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-99234be1-4de3-4566-937d-6959ae4ba96c req-ea3c0fae-138b-4a72-9301-53142564db65 service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-99234be1-4de3-4566-937d-6959ae4ba96c req-ea3c0fae-138b-4a72-9301-53142564db65 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-99234be1-4de3-4566-937d-6959ae4ba96c req-ea3c0fae-138b-4a72-9301-53142564db65 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:18 user nova-compute[75305]: DEBUG nova.compute.manager [req-99234be1-4de3-4566-937d-6959ae4ba96c req-ea3c0fae-138b-4a72-9301-53142564db65 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:38:18 user nova-compute[75305]: WARNING nova.compute.manager [req-99234be1-4de3-4566-937d-6959ae4ba96c req-ea3c0fae-138b-4a72-9301-53142564db65 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state active and task_state rescuing.
Nov 14 08:38:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance destroyed successfully.
Nov 14 08:38:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Attempting rescue
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75305) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance directory exists: not creating {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 08:38:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Creating image(s)
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue" returned: 0 in 0.048s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'migration_context' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.base [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<2f193a71-608f-4406-ae3b-b3b5e36e9674> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Start _get_guest_xml network_info=[{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:6e:37:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'resources' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.base [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<2f193a71-608f-4406-ae3b-b3b5e36e9674> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.base [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<2f193a71-608f-4406-ae3b-b3b5e36e9674> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:38:19 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:38:19 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.base [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<2f193a71-608f-4406-ae3b-b3b5e36e9674> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442171780',display_name='tempest-ServerRescueNegativeTestJSON-server-1442171780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442171780',id=49,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsSCgXyTHC7dTAO20YwecW8PWu30xQRS8tZIbS9y9/elJHpeorq8PHX7nq7smJLg3JLUjRMcByb2mKG+n/vg1ZJB+NZ+yl3AHXhjBtKvBORlOt9sdz3kntkGdDeadumrQ==',key_name='tempest-keypair-803852582',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:36:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-tc4uswe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:36:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=2f193a71-608f-4406-ae3b-b3b5e36e9674,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:6e:37:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "vif_mac": "fa:16:3e:6e:37:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.objects.base [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Object Instance<2f193a71-608f-4406-ae3b-b3b5e36e9674> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:38:19 user nova-compute[75305]:   <uuid>2f193a71-608f-4406-ae3b-b3b5e36e9674</uuid>
Nov 14 08:38:19 user nova-compute[75305]:   <name>instance-00000031</name>
Nov 14 08:38:19 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:38:19 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:38:19 user nova-compute[75305]:   <metadata>
Nov 14 08:38:19 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:38:19 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:38:19 user nova-compute[75305]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1442171780</nova:name>
Nov 14 08:38:19 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:38:19</nova:creationTime>
Nov 14 08:38:19 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:38:19 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:38:19 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:38:19 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:38:19 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:38:19 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:38:19 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:38:19 user nova-compute[75305]:       <nova:owner>
Nov 14 08:38:19 user nova-compute[75305]:         <nova:user uuid="d9bee7b3e5f0483d94a46fbed06604c5">tempest-ServerRescueNegativeTestJSON-300947473-project-member</nova:user>
Nov 14 08:38:19 user nova-compute[75305]:         <nova:project uuid="7369e5af19a940d69cec15ce79234459">tempest-ServerRescueNegativeTestJSON-300947473</nova:project>
Nov 14 08:38:19 user nova-compute[75305]:       </nova:owner>
Nov 14 08:38:19 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:38:19 user nova-compute[75305]:       <nova:ports>
Nov 14 08:38:19 user nova-compute[75305]:         <nova:port uuid="0478e8a7-3488-42ac-acb2-2a110d5997ff">
Nov 14 08:38:19 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:38:19 user nova-compute[75305]:         </nova:port>
Nov 14 08:38:19 user nova-compute[75305]:       </nova:ports>
Nov 14 08:38:19 user nova-compute[75305]:     </nova:instance>
Nov 14 08:38:19 user nova-compute[75305]:   </metadata>
Nov 14 08:38:19 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:38:19 user nova-compute[75305]:     <system>
Nov 14 08:38:19 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:38:19 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:38:19 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:38:19 user nova-compute[75305]:       <entry name="serial">2f193a71-608f-4406-ae3b-b3b5e36e9674</entry>
Nov 14 08:38:19 user nova-compute[75305]:       <entry name="uuid">2f193a71-608f-4406-ae3b-b3b5e36e9674</entry>
Nov 14 08:38:19 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:38:19 user nova-compute[75305]:     </system>
Nov 14 08:38:19 user nova-compute[75305]:   </sysinfo>
Nov 14 08:38:19 user nova-compute[75305]:   <os>
Nov 14 08:38:19 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:38:19 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:38:19 user nova-compute[75305]:   </os>
Nov 14 08:38:19 user nova-compute[75305]:   <features>
Nov 14 08:38:19 user nova-compute[75305]:     <acpi/>
Nov 14 08:38:19 user nova-compute[75305]:     <apic/>
Nov 14 08:38:19 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:38:19 user nova-compute[75305]:   </features>
Nov 14 08:38:19 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:38:19 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:38:19 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:38:19 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:38:19 user nova-compute[75305]:   </clock>
Nov 14 08:38:19 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:38:19 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:38:19 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:38:19 user nova-compute[75305]:   </cpu>
Nov 14 08:38:19 user nova-compute[75305]:   <devices>
Nov 14 08:38:19 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:38:19 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:38:19 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue"/>
Nov 14 08:38:19 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:38:19 user nova-compute[75305]:     </disk>
Nov 14 08:38:19 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:38:19 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:38:19 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk"/>
Nov 14 08:38:19 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:38:19 user nova-compute[75305]:     </disk>
Nov 14 08:38:19 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:38:19 user nova-compute[75305]:       <mac address="fa:16:3e:6e:37:8d"/>
Nov 14 08:38:19 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:38:19 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:38:19 user nova-compute[75305]:       <target dev="tap0478e8a7-34"/>
Nov 14 08:38:19 user nova-compute[75305]:     </interface>
Nov 14 08:38:19 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:38:19 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/console.log" append="off"/>
Nov 14 08:38:19 user nova-compute[75305]:     </serial>
Nov 14 08:38:19 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:38:19 user nova-compute[75305]:     <video>
Nov 14 08:38:19 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:38:19 user nova-compute[75305]:     </video>
Nov 14 08:38:19 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:38:19 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:38:19 user nova-compute[75305]:     </rng>
Nov 14 08:38:19 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:38:19 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:38:19 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:38:19 user nova-compute[75305]:     </memballoon>
Nov 14 08:38:19 user nova-compute[75305]:   </devices>
Nov 14 08:38:19 user nova-compute[75305]: </domain>
Nov 14 08:38:19 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:38:19 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance destroyed successfully.
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:38:19 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] No VIF found with MAC fa:16:3e:6e:37:8d, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:38:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-4c92c348-7824-4a6f-bf0d-66133bb905a2 req-d00b2b02-52d1-49fe-a67e-8b308524bc3e service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4c92c348-7824-4a6f-bf0d-66133bb905a2 req-d00b2b02-52d1-49fe-a67e-8b308524bc3e service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4c92c348-7824-4a6f-bf0d-66133bb905a2 req-d00b2b02-52d1-49fe-a67e-8b308524bc3e service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:20 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4c92c348-7824-4a6f-bf0d-66133bb905a2 req-d00b2b02-52d1-49fe-a67e-8b308524bc3e service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:20 user nova-compute[75305]: DEBUG nova.compute.manager [req-4c92c348-7824-4a6f-bf0d-66133bb905a2 req-d00b2b02-52d1-49fe-a67e-8b308524bc3e service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:38:20 user nova-compute[75305]: WARNING nova.compute.manager [req-4c92c348-7824-4a6f-bf0d-66133bb905a2 req-d00b2b02-52d1-49fe-a67e-8b308524bc3e service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state active and task_state rescuing.
Nov 14 08:38:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:38:23 user nova-compute[75305]: WARNING nova.compute.manager [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state active and task_state rescuing.
Nov 14 08:38:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:23 user nova-compute[75305]: DEBUG nova.compute.manager [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:38:23 user nova-compute[75305]: WARNING nova.compute.manager [req-74ed1a7c-2916-43d7-8b41-c928bfe52abd req-673a6c9d-74d4-442e-90c2-611034542867 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state active and task_state rescuing.
Nov 14 08:38:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4d3d132e-1768-476d-ac70-30b09d09254c tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:38:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:38:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:38:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:38:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:38:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:38:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:43 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:38:43 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=24.964675903320312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea106c92-184a-4748-bc95-78cb23eb76b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 52b5db0e-1eae-40ff-b48d-2b7614fdb463 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:38:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-changed-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG nova.compute.manager [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Refreshing instance network info cache due to event network-changed-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] Acquiring lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] Acquired lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Refreshing network info cache for port 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updated VIF entry in instance network info cache for port 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG nova.network.neutron [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updating instance_info_cache with network_info: [{"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:38:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-ae25b716-28ec-418b-8ba2-decce41f04d6 req-5b82870b-cae9-4193-94d6-27024f4af3b7 service nova] Releasing lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:38:46 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:46 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:46 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:47 user nova-compute[75305]: INFO nova.compute.manager [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Terminating instance
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-changed-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Refreshing instance network info cache due to event network-changed-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] Acquiring lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] Acquired lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.network.neutron [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Refreshing network info cache for port 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-c1b4f2d7-0841-4d18-b1c4-713d14613f0d req-90f3812b-be2d-42ac-9881-fa240b725f7c service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-vif-unplugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c1b4f2d7-0841-4d18-b1c4-713d14613f0d req-90f3812b-be2d-42ac-9881-fa240b725f7c service nova] Acquiring lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c1b4f2d7-0841-4d18-b1c4-713d14613f0d req-90f3812b-be2d-42ac-9881-fa240b725f7c service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c1b4f2d7-0841-4d18-b1c4-713d14613f0d req-90f3812b-be2d-42ac-9881-fa240b725f7c service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-c1b4f2d7-0841-4d18-b1c4-713d14613f0d req-90f3812b-be2d-42ac-9881-fa240b725f7c service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] No waiting events found dispatching network-vif-unplugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-c1b4f2d7-0841-4d18-b1c4-713d14613f0d req-90f3812b-be2d-42ac-9881-fa240b725f7c service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-vif-unplugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.network.neutron [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updated VIF entry in instance network info cache for port 009ff1fe-6395-4fa4-ae6d-d6b01d1289d8. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.network.neutron [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updating instance_info_cache with network_info: [{"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-92756ac4-e442-4955-990a-7425eecda734 req-a3a9fc49-0dc5-4ceb-81f8-2a33747f0612 service nova] Releasing lock "refresh_cache-52b5db0e-1eae-40ff-b48d-2b7614fdb463" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updating instance_info_cache with network_info: [{"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:38:47 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Instance destroyed successfully.
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.objects.instance [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'resources' on Instance uuid 52b5db0e-1eae-40ff-b48d-2b7614fdb463 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1925100689',display_name='tempest-TestVolumeBootPattern-server-1925100689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1925100689',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:37:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-vadu3nr7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:37:04Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=52b5db0e-1eae-40ff-b48d-2b7614fdb463,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "address": "fa:16:3e:39:3d:2c", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap009ff1fe-63", "ovs_interfaceid": "009ff1fe-6395-4fa4-ae6d-d6b01d1289d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:3d:2c,bridge_name='br-int',has_traffic_filtering=True,id=009ff1fe-6395-4fa4-ae6d-d6b01d1289d8,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009ff1fe-63') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG os_vif [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:3d:2c,bridge_name='br-int',has_traffic_filtering=True,id=009ff1fe-6395-4fa4-ae6d-d6b01d1289d8,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009ff1fe-63') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap009ff1fe-63, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03d42d7f-24a1-4344-8768-05331d8f975e) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:38:47 user nova-compute[75305]: INFO os_vif [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:3d:2c,bridge_name='br-int',has_traffic_filtering=True,id=009ff1fe-6395-4fa4-ae6d-d6b01d1289d8,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap009ff1fe-63')
Nov 14 08:38:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yEbdALQZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:38:47 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:38:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95531d9-145f-4ba4-931c-e993443d0261]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:38:47 user nova-compute[75305]: No targets found.
Nov 14 08:38:47 user nova-compute[75305]: iSNS:
Nov 14 08:38:47 user nova-compute[75305]: No targets found.
Nov 14 08:38:47 user nova-compute[75305]: STATIC:
Nov 14 08:38:47 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0
Nov 14 08:38:47 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:38:47 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:38:47 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9
Nov 14 08:38:47 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:38:47 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:38:47 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e
Nov 14 08:38:47 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:38:47 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:38:47 user nova-compute[75305]: FIRMWARE:
Nov 14 08:38:47 user nova-compute[75305]: No targets found.
Nov 14 08:38:47 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:38:47 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:38:47 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:38:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baf8b56-e557-4caa-98ee-93dc5958093c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc4271c-2908-42fe-8d30-12e7a49ec266]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:38:48 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:38:48 user nova-compute[75305]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:38:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:38:48 user nova-compute[75305]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e (non-flash)
Nov 14 08:38:48 user nova-compute[75305]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:38:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4410cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b2a948-5db3-45da-ad8b-9c80c3557a04]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86900f09-96bc-4291-8d9c-76442ea1b53e]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18da1e4-d8f5-4a51-a713-c2a635f2887f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cfc04e-6f1b-439e-a2df-823a6def978f]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa4cb59e8-f692db4690fc9f00', '/dev/disk/by-id/scsi-26636393264623436', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a4cb59e8') {{(pid=86224) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78e5cfb-6fe9-4332-b40f-97fbce84aeab]: (4, None) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec0a1b-0903-41ac-b4ff-7b1ec630b6fd]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d065dae-e1ae-4443-9a95-3fd4d85191b5]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260]
Nov 14 08:38:48 user nova-compute[75305]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e, portal: 172.16.0.220,3260] successful.
Nov 14 08:38:48 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51d24c97-2514-4d2c-bccd-10c549fe3d4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9801f1a9-0e41-4bea-a8dc-887adbe112a0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== disconnect_volume: return (310ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:38:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Deleting instance files /opt/stack/data/nova/instances/52b5db0e-1eae-40ff-b48d-2b7614fdb463_del
Nov 14 08:38:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Deletion of /opt/stack/data/nova/instances/52b5db0e-1eae-40ff-b48d-2b7614fdb463_del complete
Nov 14 08:38:48 user nova-compute[75305]: INFO nova.compute.manager [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 08:38:48 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:38:48 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:38:48 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Took 0.57 seconds to deallocate network for instance.
Nov 14 08:38:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-dca4a610-afa6-4038-8e0c-c24c2e7f5799 req-4fbf9873-46c5-4b97-ada1-c3ed560c5992 service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-vif-deleted-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-a48d052a-c777-4854-8ad5-7246cea1c566 req-9ae9aeaa-7843-4f97-957b-6ee9dcb03acb service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received event network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a48d052a-c777-4854-8ad5-7246cea1c566 req-9ae9aeaa-7843-4f97-957b-6ee9dcb03acb service nova] Acquiring lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a48d052a-c777-4854-8ad5-7246cea1c566 req-9ae9aeaa-7843-4f97-957b-6ee9dcb03acb service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a48d052a-c777-4854-8ad5-7246cea1c566 req-9ae9aeaa-7843-4f97-957b-6ee9dcb03acb service nova] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-a48d052a-c777-4854-8ad5-7246cea1c566 req-9ae9aeaa-7843-4f97-957b-6ee9dcb03acb service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] No waiting events found dispatching network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:38:49 user nova-compute[75305]: WARNING nova.compute.manager [req-a48d052a-c777-4854-8ad5-7246cea1c566 req-9ae9aeaa-7843-4f97-957b-6ee9dcb03acb service nova] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Received unexpected event network-vif-plugged-009ff1fe-6395-4fa4-ae6d-d6b01d1289d8 for instance with vm_state active and task_state deleting.
Nov 14 08:38:49 user nova-compute[75305]: INFO nova.compute.manager [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: 52b5db0e-1eae-40ff-b48d-2b7614fdb463] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 08:38:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:38:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:49 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Deleted allocations for instance 52b5db0e-1eae-40ff-b48d-2b7614fdb463
Nov 14 08:38:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-fe1b6bb4-1cf1-4f89-95b1-1811c5e7a7cf tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "52b5db0e-1eae-40ff-b48d-2b7614fdb463" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.823s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:38:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:38:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:39:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:39:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:39:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:39:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:39:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:39:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid ea106c92-184a-4748-bc95-78cb23eb76b2 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "41effa45-fafa-4575-9f95-f0c43849929a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "41effa45-fafa-4575-9f95-f0c43849929a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:35 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-changed-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Refreshing instance network info cache due to event network-changed-4431e6b2-7c2d-4077-a84c-7cb06c445e25. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] Acquiring lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] Acquired lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.network.neutron [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Refreshing network info cache for port 4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:42 user nova-compute[75305]: INFO nova.compute.manager [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Terminating instance
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.network.neutron [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updated VIF entry in instance network info cache for port 4431e6b2-7c2d-4077-a84c-7cb06c445e25. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.network.neutron [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updating instance_info_cache with network_info: [{"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2c7c13d-d8e7-49ba-bc85-9ffd86271e0f req-4ec36ee6-2d86-41a8-92d5-828e16d6f3dc service nova] Releasing lock "refresh_cache-ea106c92-184a-4748-bc95-78cb23eb76b2" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-b469bd3d-ece0-42c5-a48d-2b6d3f3630f2 req-c2d30fb6-5d7c-4dd2-a919-255fec8127b1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-vif-unplugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b469bd3d-ece0-42c5-a48d-2b6d3f3630f2 req-c2d30fb6-5d7c-4dd2-a919-255fec8127b1 service nova] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b469bd3d-ece0-42c5-a48d-2b6d3f3630f2 req-c2d30fb6-5d7c-4dd2-a919-255fec8127b1 service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b469bd3d-ece0-42c5-a48d-2b6d3f3630f2 req-c2d30fb6-5d7c-4dd2-a919-255fec8127b1 service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-b469bd3d-ece0-42c5-a48d-2b6d3f3630f2 req-c2d30fb6-5d7c-4dd2-a919-255fec8127b1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] No waiting events found dispatching network-vif-unplugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-b469bd3d-ece0-42c5-a48d-2b6d3f3630f2 req-c2d30fb6-5d7c-4dd2-a919-255fec8127b1 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-vif-unplugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:39:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Instance destroyed successfully.
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.objects.instance [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lazy-loading 'resources' on Instance uuid ea106c92-184a-4748-bc95-78cb23eb76b2 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:34:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1174198352',display_name='tempest-TestVolumeBootPattern-server-1174198352',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1174198352',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRMdp5LX3TJJLnn19OZC8ewKKFYvJ8yJXmCn82YjqkvGYEUsXeZ3r6ypDQbx5DuUgaiHdgIoxnIToV6KZ/wRsJ0j5enVdqsSYlQGW0LoBjOAGaLQHukZJsA2kHeKCH4Vg==',key_name='tempest-TestVolumeBootPattern-804017618',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37a5b13c6fbb417184c70151551cd2a4',ramdisk_id='',reservation_id='r-07rlb30f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1297430060',owner_user_name='tempest-TestVolumeBootPattern-1297430060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:35:07Z,user_data=None,user_id='347d5cb8a22e49948b1c210d2d62ce2b',uuid=ea106c92-184a-4748-bc95-78cb23eb76b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converting VIF {"id": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "address": "fa:16:3e:ad:59:49", "network": {"id": "c2449cd2-fac4-4128-a31b-65f068afebba", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-441189957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37a5b13c6fbb417184c70151551cd2a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4431e6b2-7c", "ovs_interfaceid": "4431e6b2-7c2d-4077-a84c-7cb06c445e25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:59:49,bridge_name='br-int',has_traffic_filtering=True,id=4431e6b2-7c2d-4077-a84c-7cb06c445e25,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4431e6b2-7c') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_vif [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:59:49,bridge_name='br-int',has_traffic_filtering=True,id=4431e6b2-7c2d-4077-a84c-7cb06c445e25,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4431e6b2-7c') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4431e6b2-7c, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d98c1dd-69f8-4e0c-a424-606696074c19) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:43 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:39:43 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8697MB free_disk=24.963497161865234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:43 user nova-compute[75305]: INFO os_vif [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:59:49,bridge_name='br-int',has_traffic_filtering=True,id=4431e6b2-7c2d-4077-a84c-7cb06c445e25,network=Network(c2449cd2-fac4-4128-a31b-65f068afebba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4431e6b2-7c')
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDnijVph', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:39:43 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e5be5f-1ba8-4c36-9142-e57f0567f92c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:39:43 user nova-compute[75305]: No targets found.
Nov 14 08:39:43 user nova-compute[75305]: iSNS:
Nov 14 08:39:43 user nova-compute[75305]: No targets found.
Nov 14 08:39:43 user nova-compute[75305]: STATIC:
Nov 14 08:39:43 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0
Nov 14 08:39:43 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:39:43 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:39:43 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9
Nov 14 08:39:43 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:39:43 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:39:43 user nova-compute[75305]: FIRMWARE:
Nov 14 08:39:43 user nova-compute[75305]: No targets found.
Nov 14 08:39:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:39:43 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:39:43 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad6fbaf-d4cc-495b-b687-140f1c2812da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc6e02d-a0d6-40fe-83c7-20e0990a73bf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:39:43 user nova-compute[75305]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:39:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 (non-flash)
Nov 14 08:39:43 user nova-compute[75305]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:39:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf440fff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea106c92-184a-4748-bc95-78cb23eb76b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef217a1a-1ae7-46c5-9cc3-08c8349ccc51]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[868fe9be-1f19-4b52-b29c-8ac6bb7f86fa]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16121216-c063-4b2d-a90a-88f86f30ab93]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[452d012c-10d1-4d2a-912c-ad34f305c4b2]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fde8c1-2a0a-435d-8b80-8e8f427dca99]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc1f822-9fd1-43a8-ac79-fcfd7b775761]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260]
Nov 14 08:39:43 user nova-compute[75305]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9, portal: 172.16.0.220,3260] successful.
Nov 14 08:39:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8985391-61a2-4abd-90ef-0cedcdc623a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cce982-7d74-4e45-aa72-fb49ad10615e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] <== disconnect_volume: return (302ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:39:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Deleting instance files /opt/stack/data/nova/instances/ea106c92-184a-4748-bc95-78cb23eb76b2_del
Nov 14 08:39:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Deletion of /opt/stack/data/nova/instances/ea106c92-184a-4748-bc95-78cb23eb76b2_del complete
Nov 14 08:39:43 user nova-compute[75305]: INFO nova.compute.manager [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 14 08:39:43 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:39:43 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:39:44 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:39:44 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Took 0.51 seconds to deallocate network for instance.
Nov 14 08:39:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-cad94614-bc0e-40eb-ad74-250efa97464b req-7efab1f4-f1b1-4e4a-8be0-2acc5ece87ee service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-vif-deleted-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:39:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-978a387b-2ebf-4ef2-a766-0d3596e2bd90 req-c26708dc-936e-4a9e-9b5f-5a3d7724ab53 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received event network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:39:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-978a387b-2ebf-4ef2-a766-0d3596e2bd90 req-c26708dc-936e-4a9e-9b5f-5a3d7724ab53 service nova] Acquiring lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-978a387b-2ebf-4ef2-a766-0d3596e2bd90 req-c26708dc-936e-4a9e-9b5f-5a3d7724ab53 service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-978a387b-2ebf-4ef2-a766-0d3596e2bd90 req-c26708dc-936e-4a9e-9b5f-5a3d7724ab53 service nova] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-978a387b-2ebf-4ef2-a766-0d3596e2bd90 req-c26708dc-936e-4a9e-9b5f-5a3d7724ab53 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] No waiting events found dispatching network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:39:44 user nova-compute[75305]: WARNING nova.compute.manager [req-978a387b-2ebf-4ef2-a766-0d3596e2bd90 req-c26708dc-936e-4a9e-9b5f-5a3d7724ab53 service nova] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Received unexpected event network-vif-plugged-4431e6b2-7c2d-4077-a84c-7cb06c445e25 for instance with vm_state active and task_state deleting.
Nov 14 08:39:45 user nova-compute[75305]: INFO nova.compute.manager [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] [instance: ea106c92-184a-4748-bc95-78cb23eb76b2] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 08:39:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:39:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:39:45 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:39:45 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:39:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:45 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Deleted allocations for instance ea106c92-184a-4748-bc95-78cb23eb76b2
Nov 14 08:39:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-caebda73-f6a0-44ec-b617-394a9f23323f tempest-TestVolumeBootPattern-1297430060 tempest-TestVolumeBootPattern-1297430060-project-member] Lock "ea106c92-184a-4748-bc95-78cb23eb76b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.201s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:39:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:39:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:39:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:39:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:40:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:40:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:09 user nova-compute[75305]: INFO nova.compute.manager [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Unrescuing
Nov 14 08:40:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG nova.objects.instance [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'flavor' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-6759cbdf-518a-4cf3-b370-7c74fff9d982 req-786d9dc5-85f6-41dc-969b-749afff44ab6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6759cbdf-518a-4cf3-b370-7c74fff9d982 req-786d9dc5-85f6-41dc-969b-749afff44ab6 service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6759cbdf-518a-4cf3-b370-7c74fff9d982 req-786d9dc5-85f6-41dc-969b-749afff44ab6 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6759cbdf-518a-4cf3-b370-7c74fff9d982 req-786d9dc5-85f6-41dc-969b-749afff44ab6 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG nova.compute.manager [req-6759cbdf-518a-4cf3-b370-7c74fff9d982 req-786d9dc5-85f6-41dc-969b-749afff44ab6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:40:09 user nova-compute[75305]: WARNING nova.compute.manager [req-6759cbdf-518a-4cf3-b370-7c74fff9d982 req-786d9dc5-85f6-41dc-969b-749afff44ab6 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:40:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:10 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance destroyed successfully.
Nov 14 08:40:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:40:11 user nova-compute[75305]: WARNING nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:40:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:40:11 user nova-compute[75305]: WARNING nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:40:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:40:11 user nova-compute[75305]: DEBUG nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:40:11 user nova-compute[75305]: WARNING nova.compute.manager [req-f2d52e7d-3752-400c-9444-89120a88a0c3 req-54962098-c3e4-4e72-84ad-fdc3dfccaffc service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state rescued and task_state unrescuing.
Nov 14 08:40:13 user nova-compute[75305]: DEBUG nova.compute.manager [None req-99e12843-31cb-40c9-9901-21e4b1144d20 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:40:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:40:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:40:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:40:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:40:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:40:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:40:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:40:45 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:40:45 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=24.953636169433594GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:40:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:40:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:40:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:40:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:40:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:40:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:40:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:40:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:40:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:40:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:41:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:41:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:41:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:41:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:41:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:41:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:41:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:41:36 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:41:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:41:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:41:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:41:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:41:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:41:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:41:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:41:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:41:47 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:41:47 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=24.95307159423828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:41:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:41:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:41:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [{"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-fbf25e85-e17d-4b6b-8a48-40a6009bf129" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:41:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:41:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:41:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.compute.manager [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing instance network info cache due to event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:01 user nova-compute[75305]: INFO nova.compute.manager [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Detaching volume 85baf342-0709-4c2a-b103-13c8294417a0
Nov 14 08:42:01 user nova-compute[75305]: INFO nova.virt.block_device [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Attempting to driver detach volume 85baf342-0709-4c2a-b103-13c8294417a0 from mountpoint /dev/vdb
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Attempting to detach device vdb from instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:42:01 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:42:01 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:42:01 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:42:01 user nova-compute[75305]:   <serial>85baf342-0709-4c2a-b103-13c8294417a0</serial>
Nov 14 08:42:01 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:42:01 user nova-compute[75305]: </disk>
Nov 14 08:42:01 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:42:01 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully detached device vdb from instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 from the persistent domain config.
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:42:01 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:42:01 user nova-compute[75305]:   <source dev="/dev/sdd"/>
Nov 14 08:42:01 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:42:01 user nova-compute[75305]:   <serial>85baf342-0709-4c2a-b103-13c8294417a0</serial>
Nov 14 08:42:01 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:42:01 user nova-compute[75305]: </disk>
Nov 14 08:42:01 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updated VIF entry in instance network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.network.neutron [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f95cc890-d03f-4d57-9d8b-9f3479c143d8 req-95461daa-b8a0-4869-885c-377ef59fc1b2 service nova] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:42:01 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG nova.compute.manager [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing instance network info cache due to event network-changed-0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] Acquiring lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] Acquired lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Refreshing network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updated VIF entry in instance network info cache for port 0478e8a7-3488-42ac-acb2-2a110d5997ff. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG nova.network.neutron [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [{"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6c5b15e2-e3f5-401a-b0e3-c091447b2e34 req-ac95ce11-273e-4937-937b-f531d204e3b9 service nova] Releasing lock "refresh_cache-2f193a71-608f-4406-ae3b-b3b5e36e9674" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:42:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:21 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 is timed out.
Nov 14 08:42:21 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully detached device vdb from instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 from the live domain config.
Nov 14 08:42:21 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:42:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enGNXWHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:42:21 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:42:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:42:21 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c0f1d-4b96-4f68-b95a-0edd644c3f10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:42:22 user nova-compute[75305]: No targets found.
Nov 14 08:42:22 user nova-compute[75305]: iSNS:
Nov 14 08:42:22 user nova-compute[75305]: No targets found.
Nov 14 08:42:22 user nova-compute[75305]: STATIC:
Nov 14 08:42:22 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0
Nov 14 08:42:22 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:42:22 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:42:22 user nova-compute[75305]: FIRMWARE:
Nov 14 08:42:22 user nova-compute[75305]: No targets found.
Nov 14 08:42:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:42:22 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:42:22 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61832d5-ce10-4007-add9-d86284531b58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd089f8-e0c4-4793-8be9-3c2261808ee6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:42:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 (non-flash)
Nov 14 08:42:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf207baef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0'): ({'sdd'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Removing single pathed devices sdd {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8aa1c8-dd8b-4165-820f-31c971f69efd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5085833-7d1a-4ec2-b8d5-27883c8d766b]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Flushing IO for device /dev/sdd {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a288f8aa-ad24-476c-bae8-876f893ffe21]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ee145-a889-4b65-ad3e-7def88295dcc]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] SCSI volumes sdd have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5666e88a-ef7f-4826-8806-7e2215560ed4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[600bfba3-1f1e-45fa-bc4c-ae5c56a0c010]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260]
Nov 14 08:42:22 user nova-compute[75305]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0, portal: 172.16.0.220,3260] successful.
Nov 14 08:42:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85baf342-0709-4c2a-b103-13c8294417a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c88ed0-1612-4476-9063-1fa385c26329]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] <== disconnect_volume: return (310ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:42:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'flavor' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c2361e16-fdd5-46ce-a03a-5bbbece25d81 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:42:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:42:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:42:48 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:42:48 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8869MB free_disk=24.952312469482422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 2f193a71-608f-4406-ae3b-b3b5e36e9674 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:51 user nova-compute[75305]: INFO nova.compute.manager [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Terminating instance
Nov 14 08:42:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:42:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-5c271efe-0906-41b1-bcd4-4c369bb2ff2f req-74bae4cf-58e2-43a7-b824-6f0198680fe4 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5c271efe-0906-41b1-bcd4-4c369bb2ff2f req-74bae4cf-58e2-43a7-b824-6f0198680fe4 service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5c271efe-0906-41b1-bcd4-4c369bb2ff2f req-74bae4cf-58e2-43a7-b824-6f0198680fe4 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5c271efe-0906-41b1-bcd4-4c369bb2ff2f req-74bae4cf-58e2-43a7-b824-6f0198680fe4 service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-5c271efe-0906-41b1-bcd4-4c369bb2ff2f req-74bae4cf-58e2-43a7-b824-6f0198680fe4 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.compute.manager [req-5c271efe-0906-41b1-bcd4-4c369bb2ff2f req-74bae4cf-58e2-43a7-b824-6f0198680fe4 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-unplugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:52 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Instance destroyed successfully.
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.objects.instance [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'resources' on Instance uuid 2f193a71-608f-4406-ae3b-b3b5e36e9674 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:36:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1442171780',display_name='tempest-ServerRescueNegativeTestJSON-server-1442171780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1442171780',id=49,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIsSCgXyTHC7dTAO20YwecW8PWu30xQRS8tZIbS9y9/elJHpeorq8PHX7nq7smJLg3JLUjRMcByb2mKG+n/vg1ZJB+NZ+yl3AHXhjBtKvBORlOt9sdz3kntkGdDeadumrQ==',key_name='tempest-keypair-803852582',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:38:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-tc4uswe9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=2f193a71-608f-4406-ae3b-b3b5e36e9674,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "address": "fa:16:3e:6e:37:8d", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0478e8a7-34", "ovs_interfaceid": "0478e8a7-3488-42ac-acb2-2a110d5997ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG os_vif [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0478e8a7-34, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f307aa8-314b-4d20-b015-90bec27d5a76) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:42:52 user nova-compute[75305]: INFO os_vif [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:37:8d,bridge_name='br-int',has_traffic_filtering=True,id=0478e8a7-3488-42ac-acb2-2a110d5997ff,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0478e8a7-34')
Nov 14 08:42:52 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Deleting instance files /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674_del
Nov 14 08:42:52 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Deletion of /opt/stack/data/nova/instances/2f193a71-608f-4406-ae3b-b3b5e36e9674_del complete
Nov 14 08:42:52 user nova-compute[75305]: INFO nova.compute.manager [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 08:42:52 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:42:52 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:42:53 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:53 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:42:53 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Took 0.85 seconds to deallocate network for instance.
Nov 14 08:42:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:53 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:42:53 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:42:53 user nova-compute[75305]: DEBUG nova.compute.manager [req-bb512acd-cee2-4dc1-8d20-d5efe09655d2 req-cb41d8ed-9f5c-462f-a5c5-2dd250435ac8 service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-deleted-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:42:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:53 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Deleted allocations for instance 2f193a71-608f-4406-ae3b-b3b5e36e9674
Nov 14 08:42:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-96cc2229-1ac0-44ac-ac27-7ada48c6ce40 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.046s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-9319e96d-b145-40b6-a534-a9cc4d6887ae req-fa231b97-f8d4-4692-abfa-67bcde5c8dcb service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:42:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9319e96d-b145-40b6-a534-a9cc4d6887ae req-fa231b97-f8d4-4692-abfa-67bcde5c8dcb service nova] Acquiring lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:42:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9319e96d-b145-40b6-a534-a9cc4d6887ae req-fa231b97-f8d4-4692-abfa-67bcde5c8dcb service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:42:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-9319e96d-b145-40b6-a534-a9cc4d6887ae req-fa231b97-f8d4-4692-abfa-67bcde5c8dcb service nova] Lock "2f193a71-608f-4406-ae3b-b3b5e36e9674-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:42:54 user nova-compute[75305]: DEBUG nova.compute.manager [req-9319e96d-b145-40b6-a534-a9cc4d6887ae req-fa231b97-f8d4-4692-abfa-67bcde5c8dcb service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] No waiting events found dispatching network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:42:54 user nova-compute[75305]: WARNING nova.compute.manager [req-9319e96d-b145-40b6-a534-a9cc4d6887ae req-fa231b97-f8d4-4692-abfa-67bcde5c8dcb service nova] [instance: 2f193a71-608f-4406-ae3b-b3b5e36e9674] Received unexpected event network-vif-plugged-0478e8a7-3488-42ac-acb2-2a110d5997ff for instance with vm_state deleted and task_state None.
Nov 14 08:42:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:42:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:42:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:42:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:38 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:46 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:43:47 user nova-compute[75305]: INFO nova.compute.manager [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Terminating instance
Nov 14 08:43:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-70c47bf1-ce13-40ec-b050-4a361cf559f5 req-98ebc670-2872-4ce9-b9ab-a2e7070336de service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-unplugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-70c47bf1-ce13-40ec-b050-4a361cf559f5 req-98ebc670-2872-4ce9-b9ab-a2e7070336de service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-70c47bf1-ce13-40ec-b050-4a361cf559f5 req-98ebc670-2872-4ce9-b9ab-a2e7070336de service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-70c47bf1-ce13-40ec-b050-4a361cf559f5 req-98ebc670-2872-4ce9-b9ab-a2e7070336de service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-70c47bf1-ce13-40ec-b050-4a361cf559f5 req-98ebc670-2872-4ce9-b9ab-a2e7070336de service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-unplugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-70c47bf1-ce13-40ec-b050-4a361cf559f5 req-98ebc670-2872-4ce9-b9ab-a2e7070336de service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-unplugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:43:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:43:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Instance destroyed successfully.
Nov 14 08:43:48 user nova-compute[75305]: DEBUG nova.objects.instance [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'resources' on Instance uuid fbf25e85-e17d-4b6b-8a48-40a6009bf129 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1319231213',display_name='tempest-ServerRescueNegativeTestJSON-server-1319231213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1319231213',id=45,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:29:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-qozz58e2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:29:46Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=fbf25e85-e17d-4b6b-8a48-40a6009bf129,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "ccff71eb-24e0-428d-9e54-7c309615fe14", "address": "fa:16:3e:72:de:b0", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccff71eb-24", "ovs_interfaceid": "ccff71eb-24e0-428d-9e54-7c309615fe14", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG os_vif [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccff71eb-24, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed5d65ab-b7b8-4644-975b-2ab88260a38f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:43:48 user nova-compute[75305]: INFO os_vif [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:de:b0,bridge_name='br-int',has_traffic_filtering=True,id=ccff71eb-24e0-428d-9e54-7c309615fe14,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccff71eb-24')
Nov 14 08:43:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Deleting instance files /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129_del
Nov 14 08:43:48 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Deletion of /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129_del complete
Nov 14 08:43:48 user nova-compute[75305]: INFO nova.compute.manager [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:43:48 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000002d, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/fbf25e85-e17d-4b6b-8a48-40a6009bf129/disk.rescue
Nov 14 08:43:48 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:43:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:43:49 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:43:49 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.97952651977539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 41effa45-fafa-4575-9f95-f0c43849929a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance fbf25e85-e17d-4b6b-8a48-40a6009bf129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:43:49 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Took 1.07 seconds to deallocate network for instance.
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.129s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:43:49 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Deleted allocations for instance fbf25e85-e17d-4b6b-8a48-40a6009bf129
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-6f6eb801-3fd9-45d1-ad80-c2428eb8a5aa req-809478eb-b771-4543-874b-3b10710474a9 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6f6eb801-3fd9-45d1-ad80-c2428eb8a5aa req-809478eb-b771-4543-874b-3b10710474a9 service nova] Acquiring lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6f6eb801-3fd9-45d1-ad80-c2428eb8a5aa req-809478eb-b771-4543-874b-3b10710474a9 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6f6eb801-3fd9-45d1-ad80-c2428eb8a5aa req-809478eb-b771-4543-874b-3b10710474a9 service nova] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-6f6eb801-3fd9-45d1-ad80-c2428eb8a5aa req-809478eb-b771-4543-874b-3b10710474a9 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] No waiting events found dispatching network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:43:49 user nova-compute[75305]: WARNING nova.compute.manager [req-6f6eb801-3fd9-45d1-ad80-c2428eb8a5aa req-809478eb-b771-4543-874b-3b10710474a9 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received unexpected event network-vif-plugged-ccff71eb-24e0-428d-9e54-7c309615fe14 for instance with vm_state deleted and task_state None.
Nov 14 08:43:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-6f6eb801-3fd9-45d1-ad80-c2428eb8a5aa req-809478eb-b771-4543-874b-3b10710474a9 service nova] [instance: fbf25e85-e17d-4b6b-8a48-40a6009bf129] Received event network-vif-deleted-ccff71eb-24e0-428d-9e54-7c309615fe14 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:43:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-18c176fc-5798-4776-9b3f-e6d7b97e8f7b tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "fbf25e85-e17d-4b6b-8a48-40a6009bf129" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:43:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:43:50 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:43:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [{"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-41effa45-fafa-4575-9f95-f0c43849929a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:43:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:43:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:44:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:44:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:44:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:44:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:44:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:44:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "41effa45-fafa-4575-9f95-f0c43849929a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:44:38 user nova-compute[75305]: INFO nova.compute.manager [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Terminating instance
Nov 14 08:44:38 user nova-compute[75305]: DEBUG nova.compute.manager [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG nova.compute.manager [req-f292dd8e-980e-4909-8a23-6fae011c3910 req-634dbefc-2ef4-4b0d-91d2-c66584e998a5 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f292dd8e-980e-4909-8a23-6fae011c3910 req-634dbefc-2ef4-4b0d-91d2-c66584e998a5 service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f292dd8e-980e-4909-8a23-6fae011c3910 req-634dbefc-2ef4-4b0d-91d2-c66584e998a5 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f292dd8e-980e-4909-8a23-6fae011c3910 req-634dbefc-2ef4-4b0d-91d2-c66584e998a5 service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG nova.compute.manager [req-f292dd8e-980e-4909-8a23-6fae011c3910 req-634dbefc-2ef4-4b0d-91d2-c66584e998a5 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG nova.compute.manager [req-f292dd8e-980e-4909-8a23-6fae011c3910 req-634dbefc-2ef4-4b0d-91d2-c66584e998a5 service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-unplugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:44:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:39 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Instance destroyed successfully.
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.objects.instance [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lazy-loading 'resources' on Instance uuid 41effa45-fafa-4575-9f95-f0c43849929a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:27:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1192194542',display_name='tempest-ServerRescueNegativeTestJSON-server-1192194542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1192194542',id=44,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7369e5af19a940d69cec15ce79234459',ramdisk_id='',reservation_id='r-stjl4hgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-300947473',owner_user_name='tempest-ServerRescueNegativeTestJSON-300947473-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:34:29Z,user_data=None,user_id='d9bee7b3e5f0483d94a46fbed06604c5',uuid=41effa45-fafa-4575-9f95-f0c43849929a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converting VIF {"id": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "address": "fa:16:3e:cd:9e:d1", "network": {"id": "c9398be8-967f-464c-8fa1-1d83bceea80c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1675285819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7369e5af19a940d69cec15ce79234459", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08a6385a-27", "ovs_interfaceid": "08a6385a-27d3-47f4-99b9-0c13142d2a9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG os_vif [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08a6385a-27, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aa12207-dd33-4aa5-9814-038d1dcb395f) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:39 user nova-compute[75305]: INFO os_vif [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:9e:d1,bridge_name='br-int',has_traffic_filtering=True,id=08a6385a-27d3-47f4-99b9-0c13142d2a9b,network=Network(c9398be8-967f-464c-8fa1-1d83bceea80c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08a6385a-27')
Nov 14 08:44:39 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Deleting instance files /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a_del
Nov 14 08:44:39 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Deletion of /opt/stack/data/nova/instances/41effa45-fafa-4575-9f95-f0c43849929a_del complete
Nov 14 08:44:39 user nova-compute[75305]: INFO nova.compute.manager [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 08:44:39 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:44:39 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Took 0.44 seconds to deallocate network for instance.
Nov 14 08:44:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:44:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:44:39 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Deleted allocations for instance 41effa45-fafa-4575-9f95-f0c43849929a
Nov 14 08:44:39 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-d1383a18-7c98-4d96-b3fa-a67ff000da54 tempest-ServerRescueNegativeTestJSON-300947473 tempest-ServerRescueNegativeTestJSON-300947473-project-member] Lock "41effa45-fafa-4575-9f95-f0c43849929a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.626s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:44:40 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-13095472-2e2d-4d25-bea8-3ec0a0f10b0f req-c4058fc8-0c03-4061-83f4-4fabd8ca415d service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:44:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13095472-2e2d-4d25-bea8-3ec0a0f10b0f req-c4058fc8-0c03-4061-83f4-4fabd8ca415d service nova] Acquiring lock "41effa45-fafa-4575-9f95-f0c43849929a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:44:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13095472-2e2d-4d25-bea8-3ec0a0f10b0f req-c4058fc8-0c03-4061-83f4-4fabd8ca415d service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:44:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-13095472-2e2d-4d25-bea8-3ec0a0f10b0f req-c4058fc8-0c03-4061-83f4-4fabd8ca415d service nova] Lock "41effa45-fafa-4575-9f95-f0c43849929a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:44:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-13095472-2e2d-4d25-bea8-3ec0a0f10b0f req-c4058fc8-0c03-4061-83f4-4fabd8ca415d service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] No waiting events found dispatching network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:44:40 user nova-compute[75305]: WARNING nova.compute.manager [req-13095472-2e2d-4d25-bea8-3ec0a0f10b0f req-c4058fc8-0c03-4061-83f4-4fabd8ca415d service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received unexpected event network-vif-plugged-08a6385a-27d3-47f4-99b9-0c13142d2a9b for instance with vm_state deleted and task_state None.
Nov 14 08:44:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-13095472-2e2d-4d25-bea8-3ec0a0f10b0f req-c4058fc8-0c03-4061-83f4-4fabd8ca415d service nova] [instance: 41effa45-fafa-4575-9f95-f0c43849929a] Received event network-vif-deleted-08a6385a-27d3-47f4-99b9-0c13142d2a9b {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:44:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:44:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:44:48 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:44:48 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9150MB free_disk=25.035274505615234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:44:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.154s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:44:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:44:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:44:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:44:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:44:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:44:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:45:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:45:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:45:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:45:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:45:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:45:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:45:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:45:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:45:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:45:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:45:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:45:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:45:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:45:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:40 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:45:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:40 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:45:40 user nova-compute[75305]: INFO nova.compute.claims [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Claim successful on node user
Nov 14 08:45:40 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:45:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.policy [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794f74cf3160417696ce0a164a934e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c9883fcf1e415689e4eaf7d837afaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:45:41 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Creating image(s)
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.166s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk 1073741824" returned: 0 in 0.052s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Successfully created port: 0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:45:41 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Cannot resize image /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Ensure instance console log exists: /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Successfully updated port: 0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-changed-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Refreshing instance network info cache due to event network-changed-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance network_info: |[{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.neutron [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Refreshing network info cache for port 0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Start _get_guest_xml network_info=[{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:45:42 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:45:42 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'pci_devices' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:45:42 user nova-compute[75305]:   <uuid>97e60aed-cbd3-4a79-96ff-400d27ba3b3a</uuid>
Nov 14 08:45:42 user nova-compute[75305]:   <name>instance-00000033</name>
Nov 14 08:45:42 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:45:42 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:45:42 user nova-compute[75305]:   <metadata>
Nov 14 08:45:42 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:45:42 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:45:42 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeTestJSON-server-1916035072</nova:name>
Nov 14 08:45:42 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:45:42</nova:creationTime>
Nov 14 08:45:42 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:45:42 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:45:42 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:45:42 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:45:42 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:45:42 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:45:42 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:45:42 user nova-compute[75305]:       <nova:owner>
Nov 14 08:45:42 user nova-compute[75305]:         <nova:user uuid="794f74cf3160417696ce0a164a934e41">tempest-AttachVolumeTestJSON-333546140-project-member</nova:user>
Nov 14 08:45:42 user nova-compute[75305]:         <nova:project uuid="34c9883fcf1e415689e4eaf7d837afaf">tempest-AttachVolumeTestJSON-333546140</nova:project>
Nov 14 08:45:42 user nova-compute[75305]:       </nova:owner>
Nov 14 08:45:42 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:45:42 user nova-compute[75305]:       <nova:ports>
Nov 14 08:45:42 user nova-compute[75305]:         <nova:port uuid="0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96">
Nov 14 08:45:42 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:45:42 user nova-compute[75305]:         </nova:port>
Nov 14 08:45:42 user nova-compute[75305]:       </nova:ports>
Nov 14 08:45:42 user nova-compute[75305]:     </nova:instance>
Nov 14 08:45:42 user nova-compute[75305]:   </metadata>
Nov 14 08:45:42 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:45:42 user nova-compute[75305]:     <system>
Nov 14 08:45:42 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:45:42 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:45:42 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:45:42 user nova-compute[75305]:       <entry name="serial">97e60aed-cbd3-4a79-96ff-400d27ba3b3a</entry>
Nov 14 08:45:42 user nova-compute[75305]:       <entry name="uuid">97e60aed-cbd3-4a79-96ff-400d27ba3b3a</entry>
Nov 14 08:45:42 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:45:42 user nova-compute[75305]:     </system>
Nov 14 08:45:42 user nova-compute[75305]:   </sysinfo>
Nov 14 08:45:42 user nova-compute[75305]:   <os>
Nov 14 08:45:42 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:45:42 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:45:42 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:45:42 user nova-compute[75305]:   </os>
Nov 14 08:45:42 user nova-compute[75305]:   <features>
Nov 14 08:45:42 user nova-compute[75305]:     <acpi/>
Nov 14 08:45:42 user nova-compute[75305]:     <apic/>
Nov 14 08:45:42 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:45:42 user nova-compute[75305]:   </features>
Nov 14 08:45:42 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:45:42 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:45:42 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:45:42 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:45:42 user nova-compute[75305]:   </clock>
Nov 14 08:45:42 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:45:42 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:45:42 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:45:42 user nova-compute[75305]:   </cpu>
Nov 14 08:45:42 user nova-compute[75305]:   <devices>
Nov 14 08:45:42 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:45:42 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:45:42 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk"/>
Nov 14 08:45:42 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:45:42 user nova-compute[75305]:     </disk>
Nov 14 08:45:42 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:45:42 user nova-compute[75305]:       <mac address="fa:16:3e:78:69:74"/>
Nov 14 08:45:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:45:42 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:45:42 user nova-compute[75305]:       <target dev="tap0c4c3e7a-0f"/>
Nov 14 08:45:42 user nova-compute[75305]:     </interface>
Nov 14 08:45:42 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:45:42 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/console.log" append="off"/>
Nov 14 08:45:42 user nova-compute[75305]:     </serial>
Nov 14 08:45:42 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:45:42 user nova-compute[75305]:     <video>
Nov 14 08:45:42 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:45:42 user nova-compute[75305]:     </video>
Nov 14 08:45:42 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:45:42 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:45:42 user nova-compute[75305]:     </rng>
Nov 14 08:45:42 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:45:42 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:45:42 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:45:42 user nova-compute[75305]:     </memballoon>
Nov 14 08:45:42 user nova-compute[75305]:   </devices>
Nov 14 08:45:42 user nova-compute[75305]: </domain>
Nov 14 08:45:42 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:45:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG os_vif [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6adfe71a-2453-5f73-be92-ea68b2c939b0', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c4c3e7a-0f, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c4c3e7a-0f, col_values=(('qos', UUID('a235ef53-0371-4d31-9e7f-98a62adac8dc')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c4c3e7a-0f, col_values=(('external_ids', {'iface-id': '0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:69:74', 'vm-uuid': '97e60aed-cbd3-4a79-96ff-400d27ba3b3a'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:42 user nova-compute[75305]: INFO os_vif [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f')
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:45:42 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No VIF found with MAC fa:16:3e:78:69:74, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:45:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated VIF entry in instance network info cache for port 0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:45:43 user nova-compute[75305]: DEBUG nova.network.neutron [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:45:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4bc97e05-9c09-4cdf-a8b0-02ae94f90bc3 req-eb9a9f98-66bb-4908-a604-10aeb04ac1cd service nova] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-77209632-f028-4073-a8f6-c6dfb83f4129 req-a6843b5e-530b-45b5-9553-669001a62585 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-77209632-f028-4073-a8f6-c6dfb83f4129 req-a6843b5e-530b-45b5-9553-669001a62585 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-77209632-f028-4073-a8f6-c6dfb83f4129 req-a6843b5e-530b-45b5-9553-669001a62585 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-77209632-f028-4073-a8f6-c6dfb83f4129 req-a6843b5e-530b-45b5-9553-669001a62585 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-77209632-f028-4073-a8f6-c6dfb83f4129 req-a6843b5e-530b-45b5-9553-669001a62585 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:45:44 user nova-compute[75305]: WARNING nova.compute.manager [req-77209632-f028-4073-a8f6-c6dfb83f4129 req-a6843b5e-530b-45b5-9553-669001a62585 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state building and task_state spawning.
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:45:46 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance spawned successfully.
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:45:46 user nova-compute[75305]: INFO nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:45:46 user nova-compute[75305]: INFO nova.compute.manager [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Took 5.60 seconds to build instance.
Nov 14 08:45:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b66ea533-4c64-44df-915e-4c7d47964804 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.697s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-a92e072a-1a54-4b9b-bfdb-22ec9d86c95e req-3cf831ab-b079-4a89-80ef-d84d43357e35 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a92e072a-1a54-4b9b-bfdb-22ec9d86c95e req-3cf831ab-b079-4a89-80ef-d84d43357e35 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a92e072a-1a54-4b9b-bfdb-22ec9d86c95e req-3cf831ab-b079-4a89-80ef-d84d43357e35 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-a92e072a-1a54-4b9b-bfdb-22ec9d86c95e req-3cf831ab-b079-4a89-80ef-d84d43357e35 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:46 user nova-compute[75305]: DEBUG nova.compute.manager [req-a92e072a-1a54-4b9b-bfdb-22ec9d86c95e req-3cf831ab-b079-4a89-80ef-d84d43357e35 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:45:46 user nova-compute[75305]: WARNING nova.compute.manager [req-a92e072a-1a54-4b9b-bfdb-22ec9d86c95e req-3cf831ab-b079-4a89-80ef-d84d43357e35 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state active and task_state None.
Nov 14 08:45:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:45:48 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:45:49 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:45:49 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:45:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9096MB free_disk=25.025100708007812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.230s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:45:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:45:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:45:58 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:45:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:45:58 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:45:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:46:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:46:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:46:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:46:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:46:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:46:50 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:46:50 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:46:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9002MB free_disk=24.996707916259766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:46:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:46:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:46:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:46:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:46:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-changed-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:47:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Refreshing instance network info cache due to event network-changed-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:47:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:47:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:47:31 user nova-compute[75305]: DEBUG nova.network.neutron [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Refreshing network info cache for port 0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:47:32 user nova-compute[75305]: DEBUG nova.network.neutron [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated VIF entry in instance network info cache for port 0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:47:32 user nova-compute[75305]: DEBUG nova.network.neutron [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:47:32 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-d2d08d0f-6ce9-495f-a9f7-83d4eeeccf86 req-dc461d05-b318-4b17-8db9-f68ef0044974 service nova] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:47:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:47:34 user nova-compute[75305]: INFO nova.compute.manager [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Attaching volume 4b32a695-863e-4749-af2b-08bcbdbf28ec to /dev/vdb
Nov 14 08:47:34 user nova-compute[75305]: DEBUG os_brick.utils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[733214a8-f0df-4949-bfad-3d9684c2c681]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[657b888a-c833-4bfe-a068-5c8b6ed949d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a9893c-7582-4e07-a834-7bdeefc3555c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e907ed-c9a6-45a4-92fb-a444e04d0374]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:47:34 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:47:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[51165101-5618-4879-acfb-5105093dee57]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG os_brick.utils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:47:34 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating existing volume attachment record: 8c6dfc0b-442a-4005-95c0-a042416dfde4 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:47:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTZDxAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:47:39 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:47:39 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:47:39 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f26e53-2b1e-4d7d-8615-18b310702dc6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:47:39 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22d4e49-4022-44cc-94fc-0f1a41d823f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec] added
Nov 14 08:47:39 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6856724f-8ead-4f4e-849f-953f740966e5]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[445ea963-11ce-4dfa-a12d-1feaa98b56db]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTZDxAdr {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTZDxAdr" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4708976-2146-4cb6-9321-71a310bb2481]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RTZDxAdr'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53ab3d5-cc87-4797-9cd3-94f6238d920e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01b6583-1b36-444c-8fdb-b1078b4b7e6a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:47:39 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:47:39 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:47:39 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 08:47:39 user nova-compute[75305]: 
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd291535-c408-4240-815e-a6c37dc3d297]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]
Nov 14 08:47:39 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.
Nov 14 08:47:39 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5f0422-8ebe-4ac4-afc3-3214e543427b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbde21b4-1525-4ca8-8dc6-ef4be7f89c20]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:47:39 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:47:39 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f3d2c-85a0-4ccb-98d4-7d6c39100d9d]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:47:39 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTZDxAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:47:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:47:40 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23734323761663436', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:47:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734323761663436', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:47:40 user nova-compute[75305]: DEBUG nova.objects.instance [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:47:40 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:47:40 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:47:40 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:47:40 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:47:40 user nova-compute[75305]:   <serial>4b32a695-863e-4749-af2b-08bcbdbf28ec</serial>
Nov 14 08:47:40 user nova-compute[75305]: </disk>
Nov 14 08:47:40 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:47:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:47:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:47:41 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No VIF found with MAC fa:16:3e:78:69:74, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:47:41 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-304b4652-048e-48b9-b618-eae8521b185e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.822s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6c02bf35-6baa-469c-b506-c9bda022b7ba tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6c02bf35-6baa-469c-b506-c9bda022b7ba tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.004s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6c02bf35-6baa-469c-b506-c9bda022b7ba tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6c02bf35-6baa-469c-b506-c9bda022b7ba tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75305) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6c02bf35-6baa-469c-b506-c9bda022b7ba tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-67baede4-3db5-40cb-b314-c77ed18c62e0 req-43aea97c-eb04-489b-8d5a-2fcb164d4e4e service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-67baede4-3db5-40cb-b314-c77ed18c62e0 req-43aea97c-eb04-489b-8d5a-2fcb164d4e4e service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-67baede4-3db5-40cb-b314-c77ed18c62e0 req-43aea97c-eb04-489b-8d5a-2fcb164d4e4e service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-67baede4-3db5-40cb-b314-c77ed18c62e0 req-43aea97c-eb04-489b-8d5a-2fcb164d4e4e service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:47:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-67baede4-3db5-40cb-b314-c77ed18c62e0 req-43aea97c-eb04-489b-8d5a-2fcb164d4e4e service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:47:42 user nova-compute[75305]: WARNING nova.compute.manager [req-67baede4-3db5-40cb-b314-c77ed18c62e0 req-43aea97c-eb04-489b-8d5a-2fcb164d4e4e service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state active and task_state powering-off.
Nov 14 08:47:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:43 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance destroyed successfully.
Nov 14 08:47:43 user nova-compute[75305]: DEBUG nova.compute.manager [None req-6c02bf35-6baa-469c-b506-c9bda022b7ba tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:47:43 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6c02bf35-6baa-469c-b506-c9bda022b7ba tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.855s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:47:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-1d48d4e4-66ac-45df-ae1d-e8ebc25c26e5 req-04468c70-a9c3-4a94-bbee-e4577f73d6df service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:47:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1d48d4e4-66ac-45df-ae1d-e8ebc25c26e5 req-04468c70-a9c3-4a94-bbee-e4577f73d6df service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:47:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1d48d4e4-66ac-45df-ae1d-e8ebc25c26e5 req-04468c70-a9c3-4a94-bbee-e4577f73d6df service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:47:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1d48d4e4-66ac-45df-ae1d-e8ebc25c26e5 req-04468c70-a9c3-4a94-bbee-e4577f73d6df service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:47:44 user nova-compute[75305]: DEBUG nova.compute.manager [req-1d48d4e4-66ac-45df-ae1d-e8ebc25c26e5 req-04468c70-a9c3-4a94-bbee-e4577f73d6df service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:47:44 user nova-compute[75305]: WARNING nova.compute.manager [req-1d48d4e4-66ac-45df-ae1d-e8ebc25c26e5 req-04468c70-a9c3-4a94-bbee-e4577f73d6df service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state None.
Nov 14 08:47:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:47:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:47:50 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:47:50 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:47:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9148MB free_disk=24.99566650390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:47:50 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:47:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:47:59 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:48:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:48:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:42 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:48 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:48 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:48:50 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:48:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:48:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:48:52 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9178MB free_disk=24.9951171875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:48:52 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:48:53 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:48:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:56 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:48:56 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:48:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:48:59 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:02 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:07 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:12 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:17 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:49:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:49:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:49:22 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:25 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Triggering sync for uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 08:49:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:49:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:49:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:49:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:32 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.objects.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.network.neutron [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:49:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance destroyed successfully.
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'resources' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.objects.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_vif [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c4c3e7a-0f, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a235ef53-0371-4d31-9e7f-98a62adac8dc) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:33 user nova-compute[75305]: INFO os_vif [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f')
Nov 14 08:49:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTZDxAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:49:33 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2677335-a03f-4531-833f-f4dcb138845c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:49:33 user nova-compute[75305]: No targets found.
Nov 14 08:49:33 user nova-compute[75305]: iSNS:
Nov 14 08:49:33 user nova-compute[75305]: No targets found.
Nov 14 08:49:33 user nova-compute[75305]: STATIC:
Nov 14 08:49:33 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec
Nov 14 08:49:33 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:49:33 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:49:33 user nova-compute[75305]: FIRMWARE:
Nov 14 08:49:33 user nova-compute[75305]: No targets found.
Nov 14 08:49:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:49:33 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:49:33 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[862058bb-dfe1-4ffe-aed8-0294de903c8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd041cb9-b617-44b1-b9c7-5a457f3acb55]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:49:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:49:33 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf207d1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f518f15-f05e-432c-82b9-1b91a3a2fc3f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5223f0-6259-4cc8-a76b-486f90d09c57]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:49:33 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[afafe035-8435-446f-98eb-911b6dc29d6a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e3e8f4-d97a-4cd1-b95d-49fb50a2d5d3]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5246d7-2556-4c0f-a7fb-178764c5ec7c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea31f30-d015-4b25-bdd8-d544b5a5577e]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]
Nov 14 08:49:34 user nova-compute[75305]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.
Nov 14 08:49:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7ea9f0-c956-445e-a251-f7cf93358cc7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== disconnect_volume: return (324ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Start _get_guest_xml network_info=[{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '8c6dfc0b-442a-4005-95c0-a042416dfde4', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTZDxAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '97e60aed-cbd3-4a79-96ff-400d27ba3b3a', 'attached_at': '', 'detached_at': '', 'volume_id': '4b32a695-863e-4749-af2b-08bcbdbf28ec', 'serial': '4b32a695-863e-4749-af2b-08bcbdbf28ec'}, 'guest_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'numa_topology' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:49:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:49:34 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.objects.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTZDxAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:49:34 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:49:34 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:49:34 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[772d8bf1-2841-4f6d-8c7e-e0d47f90f6a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:49:34 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a7d73d-016b-4e1c-9eba-7552a7fb81e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec] added
Nov 14 08:49:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d10626-b430-4af1-bd1f-df0e44df2aae]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ec65e-482e-4f92-a3f3-2d0b78f8f370]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTZDxAdr {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RTZDxAdr" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b16d638-57fc-4412-9264-01d137b93b0f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RTZDxAdr'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7b3cb8-9517-424b-b450-ca49eb340f93]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c35ff7-d641-4bdd-88c0-9dc7413df5ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:49:34 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:49:34 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:49:34 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 08:49:34 user nova-compute[75305]: 
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad90b50-335b-4cf8-93ee-be8fc762b3d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]
Nov 14 08:49:34 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.
Nov 14 08:49:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbd1999-04db-40e9-9f93-464193813096]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a0547f-ab32-4d88-bcb5-5f2d62d34def]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:49:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:49:34 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da34562-825d-4908-ae19-9c4be6b88ea1]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:49:34 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTZDxAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '23734323761663436', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734323761663436', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'pci_devices' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.objects.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:49:35 user nova-compute[75305]:   <uuid>97e60aed-cbd3-4a79-96ff-400d27ba3b3a</uuid>
Nov 14 08:49:35 user nova-compute[75305]:   <name>instance-00000033</name>
Nov 14 08:49:35 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:49:35 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:49:35 user nova-compute[75305]:   <metadata>
Nov 14 08:49:35 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:49:35 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:49:35 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeTestJSON-server-1916035072</nova:name>
Nov 14 08:49:35 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:49:34</nova:creationTime>
Nov 14 08:49:35 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:49:35 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:49:35 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:49:35 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:49:35 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:49:35 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:49:35 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:49:35 user nova-compute[75305]:       <nova:owner>
Nov 14 08:49:35 user nova-compute[75305]:         <nova:user uuid="794f74cf3160417696ce0a164a934e41">tempest-AttachVolumeTestJSON-333546140-project-member</nova:user>
Nov 14 08:49:35 user nova-compute[75305]:         <nova:project uuid="34c9883fcf1e415689e4eaf7d837afaf">tempest-AttachVolumeTestJSON-333546140</nova:project>
Nov 14 08:49:35 user nova-compute[75305]:       </nova:owner>
Nov 14 08:49:35 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:49:35 user nova-compute[75305]:       <nova:ports>
Nov 14 08:49:35 user nova-compute[75305]:         <nova:port uuid="0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96">
Nov 14 08:49:35 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:49:35 user nova-compute[75305]:         </nova:port>
Nov 14 08:49:35 user nova-compute[75305]:       </nova:ports>
Nov 14 08:49:35 user nova-compute[75305]:     </nova:instance>
Nov 14 08:49:35 user nova-compute[75305]:   </metadata>
Nov 14 08:49:35 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:49:35 user nova-compute[75305]:     <system>
Nov 14 08:49:35 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:49:35 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:49:35 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:49:35 user nova-compute[75305]:       <entry name="serial">97e60aed-cbd3-4a79-96ff-400d27ba3b3a</entry>
Nov 14 08:49:35 user nova-compute[75305]:       <entry name="uuid">97e60aed-cbd3-4a79-96ff-400d27ba3b3a</entry>
Nov 14 08:49:35 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:49:35 user nova-compute[75305]:     </system>
Nov 14 08:49:35 user nova-compute[75305]:   </sysinfo>
Nov 14 08:49:35 user nova-compute[75305]:   <os>
Nov 14 08:49:35 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:49:35 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:49:35 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:49:35 user nova-compute[75305]:   </os>
Nov 14 08:49:35 user nova-compute[75305]:   <features>
Nov 14 08:49:35 user nova-compute[75305]:     <acpi/>
Nov 14 08:49:35 user nova-compute[75305]:     <apic/>
Nov 14 08:49:35 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:49:35 user nova-compute[75305]:   </features>
Nov 14 08:49:35 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:49:35 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:49:35 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:49:35 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:49:35 user nova-compute[75305]:   </clock>
Nov 14 08:49:35 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:49:35 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:49:35 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:49:35 user nova-compute[75305]:   </cpu>
Nov 14 08:49:35 user nova-compute[75305]:   <devices>
Nov 14 08:49:35 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:49:35 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:49:35 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk"/>
Nov 14 08:49:35 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:49:35 user nova-compute[75305]:     </disk>
Nov 14 08:49:35 user nova-compute[75305]:     <disk type="block" device="disk">
Nov 14 08:49:35 user nova-compute[75305]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:49:35 user nova-compute[75305]:       <source dev="/dev/sdb"/>
Nov 14 08:49:35 user nova-compute[75305]:       <target dev="vdb" bus="virtio"/>
Nov 14 08:49:35 user nova-compute[75305]:       <serial>4b32a695-863e-4749-af2b-08bcbdbf28ec</serial>
Nov 14 08:49:35 user nova-compute[75305]:     </disk>
Nov 14 08:49:35 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:49:35 user nova-compute[75305]:       <mac address="fa:16:3e:78:69:74"/>
Nov 14 08:49:35 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:49:35 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:49:35 user nova-compute[75305]:       <target dev="tap0c4c3e7a-0f"/>
Nov 14 08:49:35 user nova-compute[75305]:     </interface>
Nov 14 08:49:35 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:49:35 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/console.log" append="off"/>
Nov 14 08:49:35 user nova-compute[75305]:     </serial>
Nov 14 08:49:35 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:49:35 user nova-compute[75305]:     <video>
Nov 14 08:49:35 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:49:35 user nova-compute[75305]:     </video>
Nov 14 08:49:35 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:49:35 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:49:35 user nova-compute[75305]:     </rng>
Nov 14 08:49:35 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:49:35 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:49:35 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:49:35 user nova-compute[75305]:     </memballoon>
Nov 14 08:49:35 user nova-compute[75305]:   </devices>
Nov 14 08:49:35 user nova-compute[75305]: </domain>
Nov 14 08:49:35 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:49:35 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.objects.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Cannot resize image /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'migration_context' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.objects.base [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG os_vif [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6adfe71a-2453-5f73-be92-ea68b2c939b0', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c4c3e7a-0f, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c4c3e7a-0f, col_values=(('qos', UUID('0a0b9629-cb52-4df6-b54f-bc90a3721351')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c4c3e7a-0f, col_values=(('external_ids', {'iface-id': '0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:69:74', 'vm-uuid': '97e60aed-cbd3-4a79-96ff-400d27ba3b3a'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:36 user nova-compute[75305]: INFO os_vif [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f')
Nov 14 08:49:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:37 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-57bec258-679b-477a-b7fe-37de9044787e req-852491a1-eb04-4af5-abe1-16677648dfba service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:49:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-57bec258-679b-477a-b7fe-37de9044787e req-852491a1-eb04-4af5-abe1-16677648dfba service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:49:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-57bec258-679b-477a-b7fe-37de9044787e req-852491a1-eb04-4af5-abe1-16677648dfba service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:49:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-57bec258-679b-477a-b7fe-37de9044787e req-852491a1-eb04-4af5-abe1-16677648dfba service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:49:37 user nova-compute[75305]: DEBUG nova.compute.manager [req-57bec258-679b-477a-b7fe-37de9044787e req-852491a1-eb04-4af5-abe1-16677648dfba service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:49:37 user nova-compute[75305]: WARNING nova.compute.manager [req-57bec258-679b-477a-b7fe-37de9044787e req-852491a1-eb04-4af5-abe1-16677648dfba service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state powering-on.
Nov 14 08:49:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:39 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:49:39 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance rebooted successfully.
Nov 14 08:49:39 user nova-compute[75305]: DEBUG nova.compute.manager [None req-3873f1c3-147b-4afc-9c57-5439375bfbec tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:49:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-0832c762-2db8-41e1-980b-e743f71a92a7 req-bf0afc91-1174-466c-b0e5-b9f7199a3c52 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:49:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0832c762-2db8-41e1-980b-e743f71a92a7 req-bf0afc91-1174-466c-b0e5-b9f7199a3c52 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:49:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0832c762-2db8-41e1-980b-e743f71a92a7 req-bf0afc91-1174-466c-b0e5-b9f7199a3c52 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:49:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-0832c762-2db8-41e1-980b-e743f71a92a7 req-bf0afc91-1174-466c-b0e5-b9f7199a3c52 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:49:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-0832c762-2db8-41e1-980b-e743f71a92a7 req-bf0afc91-1174-466c-b0e5-b9f7199a3c52 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:49:40 user nova-compute[75305]: WARNING nova.compute.manager [req-0832c762-2db8-41e1-980b-e743f71a92a7 req-bf0afc91-1174-466c-b0e5-b9f7199a3c52 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state active and task_state None.
Nov 14 08:49:41 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:49 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:49:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:49:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:49:53 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:49:53 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:49:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=24.99383544921875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:49:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:49:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:49:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:49:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:50:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:50:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:50:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:50:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:50:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:50:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:50:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:50:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:50:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:50:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:42 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:50:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:50:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75305) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 08:50:53 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:50:53 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:50:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=24.99309539794922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:50:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:50:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:50:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:50:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:51:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:51:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:51:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:24 user nova-compute[75305]: INFO nova.compute.manager [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Detaching volume 4b32a695-863e-4749-af2b-08bcbdbf28ec
Nov 14 08:51:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:24 user nova-compute[75305]: INFO nova.virt.block_device [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Attempting to driver detach volume 4b32a695-863e-4749-af2b-08bcbdbf28ec from mountpoint /dev/vdb
Nov 14 08:51:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Attempting to detach device vdb from instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:51:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:51:24 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:51:24 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:51:24 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:51:24 user nova-compute[75305]:   <serial>4b32a695-863e-4749-af2b-08bcbdbf28ec</serial>
Nov 14 08:51:24 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:51:24 user nova-compute[75305]: </disk>
Nov 14 08:51:24 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:51:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully detached device vdb from instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a from the persistent domain config.
Nov 14 08:51:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:51:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:51:24 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:51:24 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:51:24 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:51:24 user nova-compute[75305]:   <serial>4b32a695-863e-4749-af2b-08bcbdbf28ec</serial>
Nov 14 08:51:24 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 08:51:24 user nova-compute[75305]: </disk>
Nov 14 08:51:24 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:51:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:51:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:51:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:44 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a is timed out.
Nov 14 08:51:44 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully detached device vdb from instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a from the live domain config.
Nov 14 08:51:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RTZDxAdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:51:44 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:51:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[135bd9f2-abfc-4fda-91db-2062f0b88970]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:51:44 user nova-compute[75305]: No targets found.
Nov 14 08:51:44 user nova-compute[75305]: iSNS:
Nov 14 08:51:44 user nova-compute[75305]: No targets found.
Nov 14 08:51:44 user nova-compute[75305]: STATIC:
Nov 14 08:51:44 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec
Nov 14 08:51:44 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:51:44 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:51:44 user nova-compute[75305]: FIRMWARE:
Nov 14 08:51:44 user nova-compute[75305]: No targets found.
Nov 14 08:51:44 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:51:44 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:51:44 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:51:44 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a62ed1b-6504-46c0-b372-38b091fac859]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab27af4-4114-4790-abb4-6d16ab5f569f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:51:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec (non-flash)
Nov 14 08:51:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf4410c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847bcc8-2092-4f9f-9680-8a4756966eca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0496a3-3a50-475b-8920-07e41725742a]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc27fe2-5d4f-48a5-a49f-3cdeb8baa996]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac48788-886a-49a8-b609-f427c6c641a6]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156fd5e-9af8-4113-be85-212de76d3ab7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc2346f-981e-4ffc-9cba-f4034218ffd1]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260]
Nov 14 08:51:45 user nova-compute[75305]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec, portal: 172.16.0.220,3260] successful.
Nov 14 08:51:45 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b32a695-863e-4749-af2b-08bcbdbf28ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0b1473-1294-47dc-add0-13faf005a42e]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== disconnect_volume: return (310ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:51:45 user nova-compute[75305]: DEBUG nova.objects.instance [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-347f4b3c-6a35-4556-b5f0-c68c86e235c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.626s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f106840d-17ac-4677-9da9-80287a4648d6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f106840d-17ac-4677-9da9-80287a4648d6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f106840d-17ac-4677-9da9-80287a4648d6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f106840d-17ac-4677-9da9-80287a4648d6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75305) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 08:51:46 user nova-compute[75305]: DEBUG nova.objects.instance [None req-f106840d-17ac-4677-9da9-80287a4648d6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-745bda7a-7e5e-4e7d-ba53-d21539aa3edc req-9f8aa8ee-b70d-41eb-9755-3be1023b8a8e service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-745bda7a-7e5e-4e7d-ba53-d21539aa3edc req-9f8aa8ee-b70d-41eb-9755-3be1023b8a8e service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-745bda7a-7e5e-4e7d-ba53-d21539aa3edc req-9f8aa8ee-b70d-41eb-9755-3be1023b8a8e service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-745bda7a-7e5e-4e7d-ba53-d21539aa3edc req-9f8aa8ee-b70d-41eb-9755-3be1023b8a8e service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-745bda7a-7e5e-4e7d-ba53-d21539aa3edc req-9f8aa8ee-b70d-41eb-9755-3be1023b8a8e service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:51:47 user nova-compute[75305]: WARNING nova.compute.manager [req-745bda7a-7e5e-4e7d-ba53-d21539aa3edc req-9f8aa8ee-b70d-41eb-9755-3be1023b8a8e service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state active and task_state powering-off.
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance destroyed successfully.
Nov 14 08:51:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-f106840d-17ac-4677-9da9-80287a4648d6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-f106840d-17ac-4677-9da9-80287a4648d6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.847s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:51:49 user nova-compute[75305]: WARNING nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state None.
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:51:49 user nova-compute[75305]: WARNING nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state None.
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:51:49 user nova-compute[75305]: WARNING nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state None.
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:51:49 user nova-compute[75305]: WARNING nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state None.
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:51:49 user nova-compute[75305]: WARNING nova.compute.manager [req-47414dd1-8a4f-428b-ab0b-12f15b554929 req-44c428c1-92af-4eb8-b4fc-79b41eaa7b86 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state None.
Nov 14 08:51:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:51:53 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:51:54 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:51:54 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:51:54 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9140MB free_disk=24.992145538330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:51:54 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:51:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:51:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:51:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:51:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:51:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:51:59 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:52:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:52:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:52:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:52:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:52:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:43 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:52:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:52:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:52:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:52:53 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:53 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:52:55 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:52:56 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:52:56 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:52:56 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9173MB free_disk=24.991580963134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:52:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:52:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:52:59 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:53:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:53:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:53:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:53:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:53:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:53:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:53:37 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:53:37 user nova-compute[75305]: DEBUG nova.network.neutron [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:53:37 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:37 user nova-compute[75305]: DEBUG nova.objects.base [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.network.neutron [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:53:38 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance destroyed successfully.
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'resources' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.base [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG os_vif [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c4c3e7a-0f, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a0b9629-cb52-4df6-b54f-bc90a3721351) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:38 user nova-compute[75305]: INFO os_vif [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f')
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Start _get_guest_xml network_info=[{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'numa_topology' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.base [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:53:38 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:53:38 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.base [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'pci_devices' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.base [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:53:38 user nova-compute[75305]:   <uuid>97e60aed-cbd3-4a79-96ff-400d27ba3b3a</uuid>
Nov 14 08:53:38 user nova-compute[75305]:   <name>instance-00000033</name>
Nov 14 08:53:38 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:53:38 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:53:38 user nova-compute[75305]:   <metadata>
Nov 14 08:53:38 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:53:38 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:53:38 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeTestJSON-server-1916035072</nova:name>
Nov 14 08:53:38 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:53:38</nova:creationTime>
Nov 14 08:53:38 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:53:38 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:53:38 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:53:38 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:53:38 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:53:38 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:53:38 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:53:38 user nova-compute[75305]:       <nova:owner>
Nov 14 08:53:38 user nova-compute[75305]:         <nova:user uuid="794f74cf3160417696ce0a164a934e41">tempest-AttachVolumeTestJSON-333546140-project-member</nova:user>
Nov 14 08:53:38 user nova-compute[75305]:         <nova:project uuid="34c9883fcf1e415689e4eaf7d837afaf">tempest-AttachVolumeTestJSON-333546140</nova:project>
Nov 14 08:53:38 user nova-compute[75305]:       </nova:owner>
Nov 14 08:53:38 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:53:38 user nova-compute[75305]:       <nova:ports>
Nov 14 08:53:38 user nova-compute[75305]:         <nova:port uuid="0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96">
Nov 14 08:53:38 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 08:53:38 user nova-compute[75305]:         </nova:port>
Nov 14 08:53:38 user nova-compute[75305]:       </nova:ports>
Nov 14 08:53:38 user nova-compute[75305]:     </nova:instance>
Nov 14 08:53:38 user nova-compute[75305]:   </metadata>
Nov 14 08:53:38 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:53:38 user nova-compute[75305]:     <system>
Nov 14 08:53:38 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:53:38 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:53:38 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:53:38 user nova-compute[75305]:       <entry name="serial">97e60aed-cbd3-4a79-96ff-400d27ba3b3a</entry>
Nov 14 08:53:38 user nova-compute[75305]:       <entry name="uuid">97e60aed-cbd3-4a79-96ff-400d27ba3b3a</entry>
Nov 14 08:53:38 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:53:38 user nova-compute[75305]:     </system>
Nov 14 08:53:38 user nova-compute[75305]:   </sysinfo>
Nov 14 08:53:38 user nova-compute[75305]:   <os>
Nov 14 08:53:38 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:53:38 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:53:38 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:53:38 user nova-compute[75305]:   </os>
Nov 14 08:53:38 user nova-compute[75305]:   <features>
Nov 14 08:53:38 user nova-compute[75305]:     <acpi/>
Nov 14 08:53:38 user nova-compute[75305]:     <apic/>
Nov 14 08:53:38 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:53:38 user nova-compute[75305]:   </features>
Nov 14 08:53:38 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:53:38 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:53:38 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:53:38 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:53:38 user nova-compute[75305]:   </clock>
Nov 14 08:53:38 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:53:38 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:53:38 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:53:38 user nova-compute[75305]:   </cpu>
Nov 14 08:53:38 user nova-compute[75305]:   <devices>
Nov 14 08:53:38 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:53:38 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:53:38 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk"/>
Nov 14 08:53:38 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:53:38 user nova-compute[75305]:     </disk>
Nov 14 08:53:38 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:53:38 user nova-compute[75305]:       <mac address="fa:16:3e:78:69:74"/>
Nov 14 08:53:38 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:53:38 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:53:38 user nova-compute[75305]:       <target dev="tap0c4c3e7a-0f"/>
Nov 14 08:53:38 user nova-compute[75305]:     </interface>
Nov 14 08:53:38 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:53:38 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/console.log" append="off"/>
Nov 14 08:53:38 user nova-compute[75305]:     </serial>
Nov 14 08:53:38 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:53:38 user nova-compute[75305]:     <video>
Nov 14 08:53:38 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:53:38 user nova-compute[75305]:     </video>
Nov 14 08:53:38 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:53:38 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:53:38 user nova-compute[75305]:     </rng>
Nov 14 08:53:38 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:53:38 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:53:38 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:53:38 user nova-compute[75305]:     </memballoon>
Nov 14 08:53:38 user nova-compute[75305]:   </devices>
Nov 14 08:53:38 user nova-compute[75305]: </domain>
Nov 14 08:53:38 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG nova.objects.base [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:53:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.166s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Cannot resize image /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG nova.objects.instance [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'migration_context' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG nova.objects.base [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Object Instance<97e60aed-cbd3-4a79-96ff-400d27ba3b3a> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75305) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:51:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG os_vif [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6adfe71a-2453-5f73-be92-ea68b2c939b0', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c4c3e7a-0f, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c4c3e7a-0f, col_values=(('qos', UUID('98902bdf-63df-4027-b015-8334241fdeed')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c4c3e7a-0f, col_values=(('external_ids', {'iface-id': '0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:69:74', 'vm-uuid': '97e60aed-cbd3-4a79-96ff-400d27ba3b3a'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:39 user nova-compute[75305]: INFO os_vif [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f')
Nov 14 08:53:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d9c3859-791e-4edb-8029-e5c67556dae3 req-cfd58129-b0bd-443b-8332-753aabeee464 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:53:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d9c3859-791e-4edb-8029-e5c67556dae3 req-cfd58129-b0bd-443b-8332-753aabeee464 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:53:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d9c3859-791e-4edb-8029-e5c67556dae3 req-cfd58129-b0bd-443b-8332-753aabeee464 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:53:40 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-2d9c3859-791e-4edb-8029-e5c67556dae3 req-cfd58129-b0bd-443b-8332-753aabeee464 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:53:40 user nova-compute[75305]: DEBUG nova.compute.manager [req-2d9c3859-791e-4edb-8029-e5c67556dae3 req-cfd58129-b0bd-443b-8332-753aabeee464 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:53:40 user nova-compute[75305]: WARNING nova.compute.manager [req-2d9c3859-791e-4edb-8029-e5c67556dae3 req-cfd58129-b0bd-443b-8332-753aabeee464 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state stopped and task_state powering-on.
Nov 14 08:53:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:53:42 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance rebooted successfully.
Nov 14 08:53:42 user nova-compute[75305]: DEBUG nova.compute.manager [None req-398144fd-3da4-4512-a1d7-86b722eebe0c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:53:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-1b2756bb-133f-4674-b1d8-4613044b0e38 req-3a2e7a10-b8f5-4b05-83aa-bd3a97daf24b service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:53:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1b2756bb-133f-4674-b1d8-4613044b0e38 req-3a2e7a10-b8f5-4b05-83aa-bd3a97daf24b service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:53:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1b2756bb-133f-4674-b1d8-4613044b0e38 req-3a2e7a10-b8f5-4b05-83aa-bd3a97daf24b service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:53:42 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-1b2756bb-133f-4674-b1d8-4613044b0e38 req-3a2e7a10-b8f5-4b05-83aa-bd3a97daf24b service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:53:42 user nova-compute[75305]: DEBUG nova.compute.manager [req-1b2756bb-133f-4674-b1d8-4613044b0e38 req-3a2e7a10-b8f5-4b05-83aa-bd3a97daf24b service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:53:42 user nova-compute[75305]: WARNING nova.compute.manager [req-1b2756bb-133f-4674-b1d8-4613044b0e38 req-3a2e7a10-b8f5-4b05-83aa-bd3a97daf24b service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state active and task_state None.
Nov 14 08:53:44 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:53:57 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:53:58 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:53:58 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=24.990375518798828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:53:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:53:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:53:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:53:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:53:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:53:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:54:02 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:54:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:54:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:54:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:54:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:54:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:54:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:54:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:54:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:54:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:54:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:54:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:54:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:54:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:54:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:54:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:54:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:55 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:54:58 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:54:59 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:54:59 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:54:59 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=24.989620208740234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:54:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:55:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:55:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:55:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:55:03 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:55:03 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [{"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-97e60aed-cbd3-4a79-96ff-400d27ba3b3a" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:55:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:55:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:55:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:55:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:55:28 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:55:28 user nova-compute[75305]: INFO nova.compute.manager [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Terminating instance
Nov 14 08:55:28 user nova-compute[75305]: DEBUG nova.compute.manager [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-5dede48f-df72-4187-ab73-6e78d50340df req-e52632ee-8ee7-4925-b1ae-9acaee72c5e1 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dede48f-df72-4187-ab73-6e78d50340df req-e52632ee-8ee7-4925-b1ae-9acaee72c5e1 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dede48f-df72-4187-ab73-6e78d50340df req-e52632ee-8ee7-4925-b1ae-9acaee72c5e1 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-5dede48f-df72-4187-ab73-6e78d50340df req-e52632ee-8ee7-4925-b1ae-9acaee72c5e1 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-5dede48f-df72-4187-ab73-6e78d50340df req-e52632ee-8ee7-4925-b1ae-9acaee72c5e1 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-5dede48f-df72-4187-ab73-6e78d50340df req-e52632ee-8ee7-4925-b1ae-9acaee72c5e1 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-unplugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Instance destroyed successfully.
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.objects.instance [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'resources' on Instance uuid 97e60aed-cbd3-4a79-96ff-400d27ba3b3a {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:45:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1916035072',display_name='tempest-AttachVolumeTestJSON-server-1916035072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1916035072',id=51,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8dwVcFP4PQCbDHk0nm3Kno1uc/QaHakn+7dXF6YmCFvDlRxV3opEHawcZCLLNTjfHL+sk/HjwgNz27KqLrRfsZ1Pz5x7wDC8s6QVIUZpQgTzq/PaqC2x960pUViqoF5Q==',key_name='tempest-keypair-672213173',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:45:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-e6r1qrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:53:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=97e60aed-cbd3-4a79-96ff-400d27ba3b3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "address": "fa:16:3e:78:69:74", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c4c3e7a-0f", "ovs_interfaceid": "0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG os_vif [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c4c3e7a-0f, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98902bdf-63df-4027-b015-8334241fdeed) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:29 user nova-compute[75305]: INFO os_vif [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:69:74,bridge_name='br-int',has_traffic_filtering=True,id=0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c4c3e7a-0f')
Nov 14 08:55:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Deleting instance files /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a_del
Nov 14 08:55:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Deletion of /opt/stack/data/nova/instances/97e60aed-cbd3-4a79-96ff-400d27ba3b3a_del complete
Nov 14 08:55:29 user nova-compute[75305]: INFO nova.compute.manager [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 08:55:29 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:55:29 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:55:30 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:55:30 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Took 0.67 seconds to deallocate network for instance.
Nov 14 08:55:30 user nova-compute[75305]: DEBUG nova.compute.manager [req-5804668c-422d-4f96-af5a-870d4b342cfc req-6717f96a-04c0-4222-a6cf-5f7a436eb196 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-deleted-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:55:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:55:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:55:30 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:55:30 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:55:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:55:30 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Deleted allocations for instance 97e60aed-cbd3-4a79-96ff-400d27ba3b3a
Nov 14 08:55:30 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-af529433-8081-48ed-96c6-a537bd6459c6 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:55:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-aa3c60e3-c7ff-4b52-8c2b-f9fe6aa25f6a req-8b03e078-0d4d-498d-abb3-fa8f4ff282e4 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:55:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aa3c60e3-c7ff-4b52-8c2b-f9fe6aa25f6a req-8b03e078-0d4d-498d-abb3-fa8f4ff282e4 service nova] Acquiring lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:55:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aa3c60e3-c7ff-4b52-8c2b-f9fe6aa25f6a req-8b03e078-0d4d-498d-abb3-fa8f4ff282e4 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:55:31 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-aa3c60e3-c7ff-4b52-8c2b-f9fe6aa25f6a req-8b03e078-0d4d-498d-abb3-fa8f4ff282e4 service nova] Lock "97e60aed-cbd3-4a79-96ff-400d27ba3b3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:55:31 user nova-compute[75305]: DEBUG nova.compute.manager [req-aa3c60e3-c7ff-4b52-8c2b-f9fe6aa25f6a req-8b03e078-0d4d-498d-abb3-fa8f4ff282e4 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] No waiting events found dispatching network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:55:31 user nova-compute[75305]: WARNING nova.compute.manager [req-aa3c60e3-c7ff-4b52-8c2b-f9fe6aa25f6a req-8b03e078-0d4d-498d-abb3-fa8f4ff282e4 service nova] [instance: 97e60aed-cbd3-4a79-96ff-400d27ba3b3a] Received unexpected event network-vif-plugged-0c4c3e7a-0ff6-4041-8ff4-40c070d8ab96 for instance with vm_state deleted and task_state None.
Nov 14 08:55:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:55:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:55:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:55:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:55:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:55:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:55:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:55:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:56:00 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:56:00 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:56:00 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9161MB free_disk=25.017135620117188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:56:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:04 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:56:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:56:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:56:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 08:56:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:56:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:56:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:23 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 08:56:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:23 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:23 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 08:56:23 user nova-compute[75305]: INFO nova.compute.claims [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Claim successful on node user
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.211s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 08:56:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.policy [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '794f74cf3160417696ce0a164a934e41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34c9883fcf1e415689e4eaf7d837afaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 08:56:24 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Creating image(s)
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "/opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "/opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.219s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.184s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk 1073741824" returned: 0 in 0.057s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.network.neutron [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Successfully created port: 4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.180s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 08:56:24 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Cannot resize image /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Ensure instance console log exists: /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Successfully updated port: 4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquired lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-changed-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.compute.manager [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Refreshing instance network info cache due to event network-changed-4d5495d4-f779-420a-a572-1d0b63fa9ffa. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] Acquiring lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.neutron [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating instance_info_cache with network_info: [{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Releasing lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Instance network_info: |[{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] Acquired lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.neutron [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Refreshing network info cache for port 4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Start _get_guest_xml network_info=[{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 08:56:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:56:25 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-809635439',display_name='tempest-AttachVolumeTestJSON-server-809635439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-809635439',id=52,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGQ8VnUbfTNGZaERHh23A7tXBnz2+hSgMRBIN+5TY3knpRTaTom2b41pCUROIg2ncsZsV37E49nZLVO5TXzsQv0XIr7FgtrUEFZ3q591+9j7OVXknRXFDLCpLMLaau48Q==',key_name='tempest-keypair-1220204614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-p5ltay7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=ea905ce9-4010-4ff0-bae5-6416b84cf448,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ae:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d5495d4-f779-420a-a572-1d0b63fa9ffa,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5495d4-f7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.objects.instance [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'pci_devices' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] End _get_guest_xml xml=<domain type="kvm">
Nov 14 08:56:25 user nova-compute[75305]:   <uuid>ea905ce9-4010-4ff0-bae5-6416b84cf448</uuid>
Nov 14 08:56:25 user nova-compute[75305]:   <name>instance-00000034</name>
Nov 14 08:56:25 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 08:56:25 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 08:56:25 user nova-compute[75305]:   <metadata>
Nov 14 08:56:25 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 08:56:25 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 08:56:25 user nova-compute[75305]:       <nova:name>tempest-AttachVolumeTestJSON-server-809635439</nova:name>
Nov 14 08:56:25 user nova-compute[75305]:       <nova:creationTime>2023-11-14 08:56:25</nova:creationTime>
Nov 14 08:56:25 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 08:56:25 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 08:56:25 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 08:56:25 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 08:56:25 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 08:56:25 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 08:56:25 user nova-compute[75305]:       </nova:flavor>
Nov 14 08:56:25 user nova-compute[75305]:       <nova:owner>
Nov 14 08:56:25 user nova-compute[75305]:         <nova:user uuid="794f74cf3160417696ce0a164a934e41">tempest-AttachVolumeTestJSON-333546140-project-member</nova:user>
Nov 14 08:56:25 user nova-compute[75305]:         <nova:project uuid="34c9883fcf1e415689e4eaf7d837afaf">tempest-AttachVolumeTestJSON-333546140</nova:project>
Nov 14 08:56:25 user nova-compute[75305]:       </nova:owner>
Nov 14 08:56:25 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 08:56:25 user nova-compute[75305]:       <nova:ports>
Nov 14 08:56:25 user nova-compute[75305]:         <nova:port uuid="4d5495d4-f779-420a-a572-1d0b63fa9ffa">
Nov 14 08:56:25 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 08:56:25 user nova-compute[75305]:         </nova:port>
Nov 14 08:56:25 user nova-compute[75305]:       </nova:ports>
Nov 14 08:56:25 user nova-compute[75305]:     </nova:instance>
Nov 14 08:56:25 user nova-compute[75305]:   </metadata>
Nov 14 08:56:25 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 08:56:25 user nova-compute[75305]:     <system>
Nov 14 08:56:25 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 08:56:25 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 08:56:25 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 08:56:25 user nova-compute[75305]:       <entry name="serial">ea905ce9-4010-4ff0-bae5-6416b84cf448</entry>
Nov 14 08:56:25 user nova-compute[75305]:       <entry name="uuid">ea905ce9-4010-4ff0-bae5-6416b84cf448</entry>
Nov 14 08:56:25 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 08:56:25 user nova-compute[75305]:     </system>
Nov 14 08:56:25 user nova-compute[75305]:   </sysinfo>
Nov 14 08:56:25 user nova-compute[75305]:   <os>
Nov 14 08:56:25 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 08:56:25 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 08:56:25 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 08:56:25 user nova-compute[75305]:   </os>
Nov 14 08:56:25 user nova-compute[75305]:   <features>
Nov 14 08:56:25 user nova-compute[75305]:     <acpi/>
Nov 14 08:56:25 user nova-compute[75305]:     <apic/>
Nov 14 08:56:25 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 08:56:25 user nova-compute[75305]:   </features>
Nov 14 08:56:25 user nova-compute[75305]:   <clock offset="utc">
Nov 14 08:56:25 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 08:56:25 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 08:56:25 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 08:56:25 user nova-compute[75305]:   </clock>
Nov 14 08:56:25 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 08:56:25 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 08:56:25 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 08:56:25 user nova-compute[75305]:   </cpu>
Nov 14 08:56:25 user nova-compute[75305]:   <devices>
Nov 14 08:56:25 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 08:56:25 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 08:56:25 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk"/>
Nov 14 08:56:25 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 08:56:25 user nova-compute[75305]:     </disk>
Nov 14 08:56:25 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 08:56:25 user nova-compute[75305]:       <mac address="fa:16:3e:33:ae:a4"/>
Nov 14 08:56:25 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:56:25 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 08:56:25 user nova-compute[75305]:       <target dev="tap4d5495d4-f7"/>
Nov 14 08:56:25 user nova-compute[75305]:     </interface>
Nov 14 08:56:25 user nova-compute[75305]:     <serial type="pty">
Nov 14 08:56:25 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/console.log" append="off"/>
Nov 14 08:56:25 user nova-compute[75305]:     </serial>
Nov 14 08:56:25 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 08:56:25 user nova-compute[75305]:     <video>
Nov 14 08:56:25 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 08:56:25 user nova-compute[75305]:     </video>
Nov 14 08:56:25 user nova-compute[75305]:     <rng model="virtio">
Nov 14 08:56:25 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 08:56:25 user nova-compute[75305]:     </rng>
Nov 14 08:56:25 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 08:56:25 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 08:56:25 user nova-compute[75305]:       <stats period="10"/>
Nov 14 08:56:25 user nova-compute[75305]:     </memballoon>
Nov 14 08:56:25 user nova-compute[75305]:   </devices>
Nov 14 08:56:25 user nova-compute[75305]: </domain>
Nov 14 08:56:25 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-809635439',display_name='tempest-AttachVolumeTestJSON-server-809635439',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-809635439',id=52,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGQ8VnUbfTNGZaERHh23A7tXBnz2+hSgMRBIN+5TY3knpRTaTom2b41pCUROIg2ncsZsV37E49nZLVO5TXzsQv0XIr7FgtrUEFZ3q591+9j7OVXknRXFDLCpLMLaau48Q==',key_name='tempest-keypair-1220204614',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-p5ltay7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T08:56:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=ea905ce9-4010-4ff0-bae5-6416b84cf448,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:ae:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d5495d4-f779-420a-a572-1d0b63fa9ffa,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5495d4-f7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG os_vif [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ae:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d5495d4-f779-420a-a572-1d0b63fa9ffa,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5495d4-f7') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6980c99a-cfb2-5be4-8470-ede8ea25624f', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d5495d4-f7, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d5495d4-f7, col_values=(('qos', UUID('955cd897-da00-49f5-a497-df9bc8bfb7fe')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d5495d4-f7, col_values=(('external_ids', {'iface-id': '4d5495d4-f779-420a-a572-1d0b63fa9ffa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:ae:a4', 'vm-uuid': 'ea905ce9-4010-4ff0-bae5-6416b84cf448'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:25 user nova-compute[75305]: INFO os_vif [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:ae:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d5495d4-f779-420a-a572-1d0b63fa9ffa,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5495d4-f7')
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:56:25 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No VIF found with MAC fa:16:3e:33:ae:a4, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:56:26 user nova-compute[75305]: DEBUG nova.network.neutron [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updated VIF entry in instance network info cache for port 4d5495d4-f779-420a-a572-1d0b63fa9ffa. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:56:26 user nova-compute[75305]: DEBUG nova.network.neutron [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating instance_info_cache with network_info: [{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:56:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-f8f7ca6d-9783-4530-9d03-62f7b64d6263 req-03403404-f859-46d0-8cdf-a6b387d5e20e service nova] Releasing lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-e565712b-912b-4737-8567-a509fddcbbda req-0133e420-0a26-4768-9a0f-a312cea5397e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e565712b-912b-4737-8567-a509fddcbbda req-0133e420-0a26-4768-9a0f-a312cea5397e service nova] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e565712b-912b-4737-8567-a509fddcbbda req-0133e420-0a26-4768-9a0f-a312cea5397e service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-e565712b-912b-4737-8567-a509fddcbbda req-0133e420-0a26-4768-9a0f-a312cea5397e service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG nova.compute.manager [req-e565712b-912b-4737-8567-a509fddcbbda req-0133e420-0a26-4768-9a0f-a312cea5397e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] No waiting events found dispatching network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:56:27 user nova-compute[75305]: WARNING nova.compute.manager [req-e565712b-912b-4737-8567-a509fddcbbda req-0133e420-0a26-4768-9a0f-a312cea5397e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received unexpected event network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa for instance with vm_state building and task_state spawning.
Nov 14 08:56:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:27 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 08:56:29 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Instance spawned successfully.
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 08:56:29 user nova-compute[75305]: INFO nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 08:56:29 user nova-compute[75305]: INFO nova.compute.manager [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Took 5.63 seconds to build instance.
Nov 14 08:56:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-784b0d47-1aa4-4f16-9be4-d4618c00f02c tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.749s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-4a7a25c3-7c76-4456-9fbf-c27205ce2499 req-f2793237-fccc-408a-89b7-dabd4c31ae35 service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a7a25c3-7c76-4456-9fbf-c27205ce2499 req-f2793237-fccc-408a-89b7-dabd4c31ae35 service nova] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a7a25c3-7c76-4456-9fbf-c27205ce2499 req-f2793237-fccc-408a-89b7-dabd4c31ae35 service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-4a7a25c3-7c76-4456-9fbf-c27205ce2499 req-f2793237-fccc-408a-89b7-dabd4c31ae35 service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:56:29 user nova-compute[75305]: DEBUG nova.compute.manager [req-4a7a25c3-7c76-4456-9fbf-c27205ce2499 req-f2793237-fccc-408a-89b7-dabd4c31ae35 service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] No waiting events found dispatching network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:56:29 user nova-compute[75305]: WARNING nova.compute.manager [req-4a7a25c3-7c76-4456-9fbf-c27205ce2499 req-f2793237-fccc-408a-89b7-dabd4c31ae35 service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received unexpected event network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa for instance with vm_state active and task_state None.
Nov 14 08:56:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:47 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:56:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:56:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:56:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:57:00 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:01 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:57:01 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:57:01 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=24.987369537353516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea905ce9-4010-4ff0-bae5-6416b84cf448 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:57:01 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:57:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating instance_info_cache with network_info: [{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:57:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:57:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:57:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:57:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:57:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:49 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:57:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:57:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:57:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:57:57 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:57:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:58:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:03 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:58:03 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:58:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9030MB free_disk=24.98681640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea905ce9-4010-4ff0-bae5-6416b84cf448 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:58:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:58:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:58:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:58:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:58:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:58:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:58:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating instance_info_cache with network_info: [{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:58:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-changed-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG nova.compute.manager [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Refreshing instance network info cache due to event network-changed-4d5495d4-f779-420a-a572-1d0b63fa9ffa. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] Acquiring lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] Acquired lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Refreshing network info cache for port 4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updated VIF entry in instance network info cache for port 4d5495d4-f779-420a-a572-1d0b63fa9ffa. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG nova.network.neutron [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating instance_info_cache with network_info: [{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:58:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-6241c724-3b2b-4a49-969f-60ea1b76090a req-1fdf3cd6-84e1-475f-b5ff-8b978ea877ea service nova] Releasing lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:58:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG nova.objects.instance [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:18 user nova-compute[75305]: INFO nova.compute.manager [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Attaching volume 0a6a7671-8360-4ccc-9e39-961fdfdb74c1 to /dev/vdb
Nov 14 08:58:18 user nova-compute[75305]: DEBUG os_brick.utils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b21c71d-1dcb-4d83-9f49-7fde11f8ea9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[568f55ac-a2e9-4f92-ae8b-ad2193686802]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d12d0-c4e2-4204-a4ed-a74fd6d10b9f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ad0fe8-b366-4a49-ba44-b5c5b96ba128]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:58:18 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:58:18 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63fd19e-5e8f-4477-b45d-4c32fc9a46dd]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG os_brick.utils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:58:18 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating existing volume attachment record: a1c5e8ae-3ced-44a0-a857-e9b15df58805 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:58:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:21 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTOCikdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:58:22 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:58:22 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:58:22 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f1a342-7351-4075-95fb-5f56c5f4cd52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:58:22 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c05c3e-d481-45f0-9b43-34141ef9f89b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1] added
Nov 14 08:58:22 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[412d97a6-8feb-44bf-ac22-c7662aa434f9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa0d9b-ef56-43de-b016-7e4e5d22417f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTOCikdn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jTOCikdn" returned: 0 in 0.027s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fd3a42-f80a-4ad8-95d8-55183d0674dc]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jTOCikdn'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d455b1-4c19-4450-a999-08805ce7b8ba]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14e0fa-30a4-434b-9ef5-d3d6c5eae062]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:58:22 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:58:22 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 08:58:22 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:58:22 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 08:58:22 user nova-compute[75305]: 
Nov 14 08:58:22 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13c4a56-4049-4e05-8015-9c9846ce3832]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260]
Nov 14 08:58:23 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260] successful.
Nov 14 08:58:23 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e945e29e-e8b2-41d5-9afb-23314d895014]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f6a4fc-e91e-4465-bb1a-60086ee38a13]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:23 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:23 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1537bdf9-0695-4888-a35f-3796ee8e00c5]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:58:23 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTOCikdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23739633365313037', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739633365313037', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG nova.objects.instance [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:58:24 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:58:24 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:58:24 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:58:24 user nova-compute[75305]:   <serial>0a6a7671-8360-4ccc-9e39-961fdfdb74c1</serial>
Nov 14 08:58:24 user nova-compute[75305]: </disk>
Nov 14 08:58:24 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No VIF found with MAC fa:16:3e:33:ae:a4, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:24 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-41daa7ba-84dd-4660-9c8c-8fd592ee79b9 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.259s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG nova.objects.instance [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:26 user nova-compute[75305]: INFO nova.compute.manager [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Attaching volume 275f48cd-9c47-47c3-a733-24daa2200b1e to /dev/vdc
Nov 14 08:58:26 user nova-compute[75305]: DEBUG os_brick.utils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2bdbab-4650-489f-96ab-cdb7b5dab137]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d95626-6d72-40ec-a477-15ad14e5ae16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5608e0-9c34-49b8-8e61-fd11125d4cee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[912cd6c7-ce67-4391-a077-dfb6057faac2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 08:58:26 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 08:58:26 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[617024c7-3f27-497b-a802-e17f19516ab7]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG os_brick.utils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:58:26 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating existing volume attachment record: 660e469f-0b81-44c6-a096-f04a1e565185 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 08:58:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNtEdbiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:58:31 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:58:31 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:58:31 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00a57a2-8683-42d6-b887-46d9a6cef1d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 08:58:31 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d703dac0-a354-4ece-b275-21ab085b1a56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e] added
Nov 14 08:58:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b3ab0-9b1f-4b01-b22a-c9603d37d2d7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ce1b29-1d19-4347-9e33-87f733b70fc6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNtEdbiu {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BNtEdbiu" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cd65d4-ed6b-40a7-9f10-50d7e99697a0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BNtEdbiu'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0607dfd1-5efd-4951-a0d8-7eb3cb1e0ed6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f9931b-cd1d-47a1-bfa8-0ef6603933d1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[618128f1-58c6-46cb-b668-f0bffc43a737]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260]
Nov 14 08:58:31 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260] successful.
Nov 14 08:58:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddafec88-32c6-4f79-9b1f-341b303d013c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a3f378-b886-4a5e-8f07-aecc62cd7260]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:31 user nova-compute[75305]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)
Nov 14 08:58:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:31 user nova-compute[75305]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)
Nov 14 08:58:31 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0186905-81cd-44b8-84dc-455368d4ec6e]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:31 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:58:32 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 08:58:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNtEdbiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 08:58:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:58:32 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23266313230376365', 'path': '/dev/sdc'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:58:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266313230376365', 'path': '/dev/sdc'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 08:58:32 user nova-compute[75305]: DEBUG nova.objects.instance [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:58:32 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 08:58:32 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:58:32 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:58:32 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:58:32 user nova-compute[75305]:   <serial>275f48cd-9c47-47c3-a733-24daa2200b1e</serial>
Nov 14 08:58:32 user nova-compute[75305]: </disk>
Nov 14 08:58:32 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] No VIF found with MAC fa:16:3e:33:ae:a4, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-79f5d840-ac85-4228-ac77-10ea01eaf197 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.437s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:33 user nova-compute[75305]: INFO nova.compute.manager [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Detaching volume 0a6a7671-8360-4ccc-9e39-961fdfdb74c1
Nov 14 08:58:33 user nova-compute[75305]: INFO nova.virt.block_device [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Attempting to driver detach volume 0a6a7671-8360-4ccc-9e39-961fdfdb74c1 from mountpoint /dev/vdb
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Attempting to detach device vdb from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:58:33 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:58:33 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:58:33 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:58:33 user nova-compute[75305]:   <serial>0a6a7671-8360-4ccc-9e39-961fdfdb74c1</serial>
Nov 14 08:58:33 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:58:33 user nova-compute[75305]: </disk>
Nov 14 08:58:33 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:58:33 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully detached device vdb from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the persistent domain config.
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:58:33 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:58:33 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:58:33 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 08:58:33 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 08:58:33 user nova-compute[75305]:   <serial>0a6a7671-8360-4ccc-9e39-961fdfdb74c1</serial>
Nov 14 08:58:33 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 08:58:33 user nova-compute[75305]: </disk>
Nov 14 08:58:33 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:58:34 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:58:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:41 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:46 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:58:51 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:54 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 is timed out.
Nov 14 08:58:54 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully detached device vdb from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the live domain config.
Nov 14 08:58:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jTOCikdn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:58:54 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a7b13-e941-49ea-99c6-2c0d6e406f7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:58:54 user nova-compute[75305]: No targets found.
Nov 14 08:58:54 user nova-compute[75305]: iSNS:
Nov 14 08:58:54 user nova-compute[75305]: No targets found.
Nov 14 08:58:54 user nova-compute[75305]: STATIC:
Nov 14 08:58:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e
Nov 14 08:58:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:58:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:58:54 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1
Nov 14 08:58:54 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:58:54 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:58:54 user nova-compute[75305]: FIRMWARE:
Nov 14 08:58:54 user nova-compute[75305]: No targets found.
Nov 14 08:58:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:58:54 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:58:54 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da727f-0dcf-4a51-9adb-3550e585c9d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a7f903-7454-47fc-9f6f-d27c0bf9823b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:54 user nova-compute[75305]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)
Nov 14 08:58:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 (non-flash)
Nov 14 08:58:54 user nova-compute[75305]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)
Nov 14 08:58:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf44690670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[022988e4-abb8-4e32-9ee0-333ed74d8f2a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e81335-a7de-4dac-aa9b-12a0d7212291]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9146518-d01e-420d-9277-77e93809fb7b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f5be3-2bd9-48b0-b70d-c77c914bb19d]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5652a8-d701-45da-b62a-f710c479d0e7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d16b27-1089-4755-b052-a608cc083d8f]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260]
Nov 14 08:58:54 user nova-compute[75305]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1, portal: 172.16.0.220,3260] successful.
Nov 14 08:58:54 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0a6a7671-8360-4ccc-9e39-961fdfdb74c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[74eefc26-7fb9-44ed-907e-ee0319dea1b7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== disconnect_volume: return (316ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:58:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:58:55 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:58:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4d7ce17d-432e-4d88-87e8-aaaf1b5d094a tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.613s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:58:56 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:58:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:58:56 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:58:56 user nova-compute[75305]: INFO nova.compute.manager [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Detaching volume 275f48cd-9c47-47c3-a733-24daa2200b1e
Nov 14 08:58:56 user nova-compute[75305]: INFO nova.virt.block_device [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Attempting to driver detach volume 275f48cd-9c47-47c3-a733-24daa2200b1e from mountpoint /dev/vdc
Nov 14 08:58:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Attempting to detach device vdc from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 08:58:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:58:56 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:58:56 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:58:56 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:58:56 user nova-compute[75305]:   <serial>275f48cd-9c47-47c3-a733-24daa2200b1e</serial>
Nov 14 08:58:56 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 08:58:56 user nova-compute[75305]: </disk>
Nov 14 08:58:56 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:58:56 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully detached device vdc from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the persistent domain config.
Nov 14 08:58:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 08:58:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 08:58:56 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 08:58:56 user nova-compute[75305]:   <source dev="/dev/sdc"/>
Nov 14 08:58:56 user nova-compute[75305]:   <target dev="vdc" bus="virtio"/>
Nov 14 08:58:56 user nova-compute[75305]:   <serial>275f48cd-9c47-47c3-a733-24daa2200b1e</serial>
Nov 14 08:58:56 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 08:58:56 user nova-compute[75305]: </disk>
Nov 14 08:58:56 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 08:58:57 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 08:58:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:58:58 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 08:59:01 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:02 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:03 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:59:03 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=24.977455139160156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance ea905ce9-4010-4ff0-bae5-6416b84cf448 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 08:59:03 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.358s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:06 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 08:59:07 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating instance_info_cache with network_info: [{"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-ea905ce9-4010-4ff0-bae5-6416b84cf448" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 08:59:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:59:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:59:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:59:11 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:13 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 08:59:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:59:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:59:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:59:16 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:17 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 is timed out.
Nov 14 08:59:17 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully detached device vdc from instance ea905ce9-4010-4ff0-bae5-6416b84cf448 from the live domain config.
Nov 14 08:59:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BNtEdbiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 08:59:17 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d05726-5512-4a55-8bf0-362f7d49b893]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 08:59:17 user nova-compute[75305]: No targets found.
Nov 14 08:59:17 user nova-compute[75305]: iSNS:
Nov 14 08:59:17 user nova-compute[75305]: No targets found.
Nov 14 08:59:17 user nova-compute[75305]: STATIC:
Nov 14 08:59:17 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e
Nov 14 08:59:17 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 08:59:17 user nova-compute[75305]:                 Iface Name: default
Nov 14 08:59:17 user nova-compute[75305]: FIRMWARE:
Nov 14 08:59:17 user nova-compute[75305]: No targets found.
Nov 14 08:59:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 08:59:17 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 08:59:17 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6378ede4-495a-4d5b-bb7b-c8cd07c9e122]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[341da16d-a7d1-46d4-9144-db1f83e2b7d6]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)
Nov 14 08:59:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e (non-flash)
Nov 14 08:59:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf20764e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e'): ({'sdc'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Removing single pathed devices sdc {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04892d52-0705-4360-89ee-c42d69f08793]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b048f9a3-ed01-40db-b63c-861eeae4388d]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Flushing IO for device /dev/sdc {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0f1fa5-236a-49ec-a307-49946430152d]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48977c3-6ca0-4713-8bba-5662a15f7e5c]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] SCSI volumes sdc have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[65215786-d164-44bf-ad3d-ccae5143e045]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[574de488-052b-4c92-b8fd-4e1a37281e45]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260]
Nov 14 08:59:17 user nova-compute[75305]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e, portal: 172.16.0.220,3260] successful.
Nov 14 08:59:17 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:275f48cd-9c47-47c3-a733-24daa2200b1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d64e86-3bfd-48cb-b5c0-dffce28cd596]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] <== disconnect_volume: return (313ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 08:59:17 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 08:59:18 user nova-compute[75305]: DEBUG nova.objects.instance [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'flavor' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:59:18 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-c11def0e-290c-4eb4-a747-29521fcacb7e tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.635s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:19 user nova-compute[75305]: INFO nova.compute.manager [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Terminating instance
Nov 14 08:59:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-fadf4169-ca47-46af-8a44-f13df2f4c645 req-8465730b-e75a-4a9f-a0f8-d540a0ce619e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-vif-unplugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fadf4169-ca47-46af-8a44-f13df2f4c645 req-8465730b-e75a-4a9f-a0f8-d540a0ce619e service nova] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fadf4169-ca47-46af-8a44-f13df2f4c645 req-8465730b-e75a-4a9f-a0f8-d540a0ce619e service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-fadf4169-ca47-46af-8a44-f13df2f4c645 req-8465730b-e75a-4a9f-a0f8-d540a0ce619e service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-fadf4169-ca47-46af-8a44-f13df2f4c645 req-8465730b-e75a-4a9f-a0f8-d540a0ce619e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] No waiting events found dispatching network-vif-unplugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG nova.compute.manager [req-fadf4169-ca47-46af-8a44-f13df2f4c645 req-8465730b-e75a-4a9f-a0f8-d540a0ce619e service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-vif-unplugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 08:59:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:20 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Instance destroyed successfully.
Nov 14 08:59:20 user nova-compute[75305]: DEBUG nova.objects.instance [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lazy-loading 'resources' on Instance uuid ea905ce9-4010-4ff0-bae5-6416b84cf448 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T08:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-809635439',display_name='tempest-AttachVolumeTestJSON-server-809635439',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-809635439',id=52,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGQ8VnUbfTNGZaERHh23A7tXBnz2+hSgMRBIN+5TY3knpRTaTom2b41pCUROIg2ncsZsV37E49nZLVO5TXzsQv0XIr7FgtrUEFZ3q591+9j7OVXknRXFDLCpLMLaau48Q==',key_name='tempest-keypair-1220204614',keypairs=<?>,launch_index=0,launched_at=2023-11-14T08:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34c9883fcf1e415689e4eaf7d837afaf',ramdisk_id='',reservation_id='r-p5ltay7k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-333546140',owner_user_name='tempest-AttachVolumeTestJSON-333546140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T08:56:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='794f74cf3160417696ce0a164a934e41',uuid=ea905ce9-4010-4ff0-bae5-6416b84cf448,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converting VIF {"id": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "address": "fa:16:3e:33:ae:a4", "network": {"id": "d7050741-724e-41de-8119-c3aaf7546314", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-543189378-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34c9883fcf1e415689e4eaf7d837afaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d5495d4-f7", "ovs_interfaceid": "4d5495d4-f779-420a-a572-1d0b63fa9ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:ae:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d5495d4-f779-420a-a572-1d0b63fa9ffa,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5495d4-f7') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG os_vif [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ae:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d5495d4-f779-420a-a572-1d0b63fa9ffa,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5495d4-f7') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d5495d4-f7, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=955cd897-da00-49f5-a497-df9bc8bfb7fe) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:20 user nova-compute[75305]: INFO os_vif [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:ae:a4,bridge_name='br-int',has_traffic_filtering=True,id=4d5495d4-f779-420a-a572-1d0b63fa9ffa,network=Network(d7050741-724e-41de-8119-c3aaf7546314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d5495d4-f7')
Nov 14 08:59:20 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Deleting instance files /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448_del
Nov 14 08:59:20 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Deletion of /opt/stack/data/nova/instances/ea905ce9-4010-4ff0-bae5-6416b84cf448_del complete
Nov 14 08:59:20 user nova-compute[75305]: INFO nova.compute.manager [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 08:59:20 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 08:59:20 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 08:59:21 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Took 1.04 seconds to deallocate network for instance.
Nov 14 08:59:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:21 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Deleted allocations for instance ea905ce9-4010-4ff0-bae5-6416b84cf448
Nov 14 08:59:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-cd6c3b07-e5f6-4097-8855-33c478754249 tempest-AttachVolumeTestJSON-333546140 tempest-AttachVolumeTestJSON-333546140-project-member] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-c339ec46-2b62-4fe1-9a11-655457a6b4f9 req-46c3fb79-6ff6-4518-ab17-c865a62135a7 service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c339ec46-2b62-4fe1-9a11-655457a6b4f9 req-46c3fb79-6ff6-4518-ab17-c865a62135a7 service nova] Acquiring lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c339ec46-2b62-4fe1-9a11-655457a6b4f9 req-46c3fb79-6ff6-4518-ab17-c865a62135a7 service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-c339ec46-2b62-4fe1-9a11-655457a6b4f9 req-46c3fb79-6ff6-4518-ab17-c865a62135a7 service nova] Lock "ea905ce9-4010-4ff0-bae5-6416b84cf448-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 08:59:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-c339ec46-2b62-4fe1-9a11-655457a6b4f9 req-46c3fb79-6ff6-4518-ab17-c865a62135a7 service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] No waiting events found dispatching network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 08:59:21 user nova-compute[75305]: WARNING nova.compute.manager [req-c339ec46-2b62-4fe1-9a11-655457a6b4f9 req-46c3fb79-6ff6-4518-ab17-c865a62135a7 service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received unexpected event network-vif-plugged-4d5495d4-f779-420a-a572-1d0b63fa9ffa for instance with vm_state deleted and task_state None.
Nov 14 08:59:21 user nova-compute[75305]: DEBUG nova.compute.manager [req-c339ec46-2b62-4fe1-9a11-655457a6b4f9 req-46c3fb79-6ff6-4518-ab17-c865a62135a7 service nova] [instance: ea905ce9-4010-4ff0-bae5-6416b84cf448] Received event network-vif-deleted-4d5495d4-f779-420a-a572-1d0b63fa9ffa {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 08:59:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 08:59:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:59:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 08:59:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 08:59:45 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 08:59:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 08:59:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:00 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:00:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:00:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:00:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:00:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.00458526611328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:00:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:00:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:00:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:00:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:00:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:00:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:00:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:00:09 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:00:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:00:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:00:52 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:00:55 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:00 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:01:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:01:04 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:01:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9248MB free_disk=25.000995635986328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:01:04 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:05 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:01:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:09 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:01:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:01:10 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:01:10 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:01:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:15 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:01:20 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:25 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:29 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:30 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:31 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:34 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:35 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:36 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:40 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:44 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Starting instance... {{(pid=75305) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 09:01:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:44 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75305) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 09:01:44 user nova-compute[75305]: INFO nova.compute.claims [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Claim successful on node user
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Start building networks asynchronously for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Allocating IP information in the background. {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] allocate_for_instance() {{(pid=75305) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 09:01:45 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Start building block device mappings for instance. {{(pid=75305) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Start spawning the instance on the hypervisor. {{(pid=75305) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Creating instance directory {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 09:01:45 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Creating image(s)
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "/opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "/opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.policy [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68d91a91cc5443d8ad4238d063b958c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f6e52babe9498c98347d3d17afe35f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75305) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.211s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "bd3fa4d08ab761532beb94b8c542750390b65b48" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk 1073741824 {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48,backing_fmt=raw /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk 1073741824" returned: 0 in 0.054s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "bd3fa4d08ab761532beb94b8c542750390b65b48" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd3fa4d08ab761532beb94b8c542750390b65b48 --force-share --output=json" returned: 0 in 0.172s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk. size=1073741824 {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 09:01:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG nova.virt.disk.api [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Cannot resize image /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk to a smaller size. {{(pid=75305) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Created local disks {{(pid=75305) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Ensure instance console log exists: /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/console.log {{(pid=75305) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:46 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Successfully created port: abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Successfully updated port: abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Building network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-changed-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.compute.manager [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Refreshing instance network info cache due to event network-changed-abc1b547-73cd-496a-95bb-8ee53d5db5d1. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Instance cache missing network info. {{(pid=75305) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.network.neutron [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Instance network_info: |[{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75305) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.network.neutron [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Refreshing network info cache for port abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Start _get_guest_xml network_info=[{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'boot_index': 0, 'encrypted': False, 'encryption_format': None, 'guest_format': None, 'encryption_options': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'image_id': '5d88aadf-7386-48ab-8524-9b99a75f107c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 09:01:47 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:01:47 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CPU controller missing on host. {{(pid=75305) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.host [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CPU controller found on host. {{(pid=75305) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75305) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T07:58:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T07:58:34Z,direct_url=<?>,disk_format='qcow2',id=5d88aadf-7386-48ab-8524-9b99a75f107c,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f9ce0c6c5ee44fcf9bd9225002b5f446',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T07:58:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Flavor limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Image limits 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Flavor pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Image pref 0:0:0 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75305) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Got 1 possible topologies {{(pid=75305) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.hardware [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75305) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1109773725',display_name='tempest-SnapshotDataIntegrityTests-server-1109773725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1109773725',id=53,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLypDeuyupnqu2uQLgMJsYdt3dNFC5znFE/zGjTUPfKXjhHb/rrDIfWJ6OwMFL2bbB7P64L/AXUWUrLaB7NG18V3nDvA1KsAmp+EuNpH7D58D7ruAe0d0N2FlJ6bbq/TwQ==',key_name='tempest-keypair-250085567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f6e52babe9498c98347d3d17afe35f',ramdisk_id='',reservation_id='r-b4zriffg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-135103649',owner_user_name='tempest-SnapshotDataIntegrityTests-135103649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d91a91cc5443d8ad4238d063b958c8',uuid=9c7b7910-7fb4-4a52-92db-7affee4b74b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75305) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Converting VIF {"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2c:32,bridge_name='br-int',has_traffic_filtering=True,id=abc1b547-73cd-496a-95bb-8ee53d5db5d1,network=Network(4602c661-92d4-4c64-a161-c75af44a3c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc1b547-73') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:01:47 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 09:01:48 user nova-compute[75305]:   <uuid>9c7b7910-7fb4-4a52-92db-7affee4b74b4</uuid>
Nov 14 09:01:48 user nova-compute[75305]:   <name>instance-00000035</name>
Nov 14 09:01:48 user nova-compute[75305]:   <memory>524288</memory>
Nov 14 09:01:48 user nova-compute[75305]:   <vcpu>1</vcpu>
Nov 14 09:01:48 user nova-compute[75305]:   <metadata>
Nov 14 09:01:48 user nova-compute[75305]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 09:01:48 user nova-compute[75305]:       <nova:package version="0.0.0"/>
Nov 14 09:01:48 user nova-compute[75305]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1109773725</nova:name>
Nov 14 09:01:48 user nova-compute[75305]:       <nova:creationTime>2023-11-14 09:01:47</nova:creationTime>
Nov 14 09:01:48 user nova-compute[75305]:       <nova:flavor name="m1.tiny">
Nov 14 09:01:48 user nova-compute[75305]:         <nova:memory>512</nova:memory>
Nov 14 09:01:48 user nova-compute[75305]:         <nova:disk>1</nova:disk>
Nov 14 09:01:48 user nova-compute[75305]:         <nova:swap>0</nova:swap>
Nov 14 09:01:48 user nova-compute[75305]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 09:01:48 user nova-compute[75305]:         <nova:vcpus>1</nova:vcpus>
Nov 14 09:01:48 user nova-compute[75305]:       </nova:flavor>
Nov 14 09:01:48 user nova-compute[75305]:       <nova:owner>
Nov 14 09:01:48 user nova-compute[75305]:         <nova:user uuid="68d91a91cc5443d8ad4238d063b958c8">tempest-SnapshotDataIntegrityTests-135103649-project-member</nova:user>
Nov 14 09:01:48 user nova-compute[75305]:         <nova:project uuid="05f6e52babe9498c98347d3d17afe35f">tempest-SnapshotDataIntegrityTests-135103649</nova:project>
Nov 14 09:01:48 user nova-compute[75305]:       </nova:owner>
Nov 14 09:01:48 user nova-compute[75305]:       <nova:root type="image" uuid="5d88aadf-7386-48ab-8524-9b99a75f107c"/>
Nov 14 09:01:48 user nova-compute[75305]:       <nova:ports>
Nov 14 09:01:48 user nova-compute[75305]:         <nova:port uuid="abc1b547-73cd-496a-95bb-8ee53d5db5d1">
Nov 14 09:01:48 user nova-compute[75305]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 09:01:48 user nova-compute[75305]:         </nova:port>
Nov 14 09:01:48 user nova-compute[75305]:       </nova:ports>
Nov 14 09:01:48 user nova-compute[75305]:     </nova:instance>
Nov 14 09:01:48 user nova-compute[75305]:   </metadata>
Nov 14 09:01:48 user nova-compute[75305]:   <sysinfo type="smbios">
Nov 14 09:01:48 user nova-compute[75305]:     <system>
Nov 14 09:01:48 user nova-compute[75305]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 09:01:48 user nova-compute[75305]:       <entry name="product">OpenStack Nova</entry>
Nov 14 09:01:48 user nova-compute[75305]:       <entry name="version">0.0.0</entry>
Nov 14 09:01:48 user nova-compute[75305]:       <entry name="serial">9c7b7910-7fb4-4a52-92db-7affee4b74b4</entry>
Nov 14 09:01:48 user nova-compute[75305]:       <entry name="uuid">9c7b7910-7fb4-4a52-92db-7affee4b74b4</entry>
Nov 14 09:01:48 user nova-compute[75305]:       <entry name="family">Virtual Machine</entry>
Nov 14 09:01:48 user nova-compute[75305]:     </system>
Nov 14 09:01:48 user nova-compute[75305]:   </sysinfo>
Nov 14 09:01:48 user nova-compute[75305]:   <os>
Nov 14 09:01:48 user nova-compute[75305]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 09:01:48 user nova-compute[75305]:     <boot dev="hd"/>
Nov 14 09:01:48 user nova-compute[75305]:     <smbios mode="sysinfo"/>
Nov 14 09:01:48 user nova-compute[75305]:   </os>
Nov 14 09:01:48 user nova-compute[75305]:   <features>
Nov 14 09:01:48 user nova-compute[75305]:     <acpi/>
Nov 14 09:01:48 user nova-compute[75305]:     <apic/>
Nov 14 09:01:48 user nova-compute[75305]:     <vmcoreinfo/>
Nov 14 09:01:48 user nova-compute[75305]:   </features>
Nov 14 09:01:48 user nova-compute[75305]:   <clock offset="utc">
Nov 14 09:01:48 user nova-compute[75305]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 09:01:48 user nova-compute[75305]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 09:01:48 user nova-compute[75305]:     <timer name="hpet" present="no"/>
Nov 14 09:01:48 user nova-compute[75305]:   </clock>
Nov 14 09:01:48 user nova-compute[75305]:   <cpu mode="custom" match="exact">
Nov 14 09:01:48 user nova-compute[75305]:     <model>Nehalem</model>
Nov 14 09:01:48 user nova-compute[75305]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 09:01:48 user nova-compute[75305]:   </cpu>
Nov 14 09:01:48 user nova-compute[75305]:   <devices>
Nov 14 09:01:48 user nova-compute[75305]:     <disk type="file" device="disk">
Nov 14 09:01:48 user nova-compute[75305]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 09:01:48 user nova-compute[75305]:       <source file="/opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk"/>
Nov 14 09:01:48 user nova-compute[75305]:       <target dev="vda" bus="virtio"/>
Nov 14 09:01:48 user nova-compute[75305]:     </disk>
Nov 14 09:01:48 user nova-compute[75305]:     <interface type="ethernet">
Nov 14 09:01:48 user nova-compute[75305]:       <mac address="fa:16:3e:ea:2c:32"/>
Nov 14 09:01:48 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 09:01:48 user nova-compute[75305]:       <mtu size="1442"/>
Nov 14 09:01:48 user nova-compute[75305]:       <target dev="tapabc1b547-73"/>
Nov 14 09:01:48 user nova-compute[75305]:     </interface>
Nov 14 09:01:48 user nova-compute[75305]:     <serial type="pty">
Nov 14 09:01:48 user nova-compute[75305]:       <log file="/opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/console.log" append="off"/>
Nov 14 09:01:48 user nova-compute[75305]:     </serial>
Nov 14 09:01:48 user nova-compute[75305]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 09:01:48 user nova-compute[75305]:     <video>
Nov 14 09:01:48 user nova-compute[75305]:       <model type="virtio"/>
Nov 14 09:01:48 user nova-compute[75305]:     </video>
Nov 14 09:01:48 user nova-compute[75305]:     <rng model="virtio">
Nov 14 09:01:48 user nova-compute[75305]:       <backend model="random">/dev/urandom</backend>
Nov 14 09:01:48 user nova-compute[75305]:     </rng>
Nov 14 09:01:48 user nova-compute[75305]:     <controller type="usb" index="0" model="none"/>
Nov 14 09:01:48 user nova-compute[75305]:     <memballoon model="virtio">
Nov 14 09:01:48 user nova-compute[75305]:       <stats period="10"/>
Nov 14 09:01:48 user nova-compute[75305]:     </memballoon>
Nov 14 09:01:48 user nova-compute[75305]:   </devices>
Nov 14 09:01:48 user nova-compute[75305]: </domain>
Nov 14 09:01:48 user nova-compute[75305]:  {{(pid=75305) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1109773725',display_name='tempest-SnapshotDataIntegrityTests-server-1109773725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1109773725',id=53,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLypDeuyupnqu2uQLgMJsYdt3dNFC5znFE/zGjTUPfKXjhHb/rrDIfWJ6OwMFL2bbB7P64L/AXUWUrLaB7NG18V3nDvA1KsAmp+EuNpH7D58D7ruAe0d0N2FlJ6bbq/TwQ==',key_name='tempest-keypair-250085567',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f6e52babe9498c98347d3d17afe35f',ramdisk_id='',reservation_id='r-b4zriffg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-135103649',owner_user_name='tempest-SnapshotDataIntegrityTests-135103649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T09:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d91a91cc5443d8ad4238d063b958c8',uuid=9c7b7910-7fb4-4a52-92db-7affee4b74b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Converting VIF {"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2c:32,bridge_name='br-int',has_traffic_filtering=True,id=abc1b547-73cd-496a-95bb-8ee53d5db5d1,network=Network(4602c661-92d4-4c64-a161-c75af44a3c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc1b547-73') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG os_vif [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2c:32,bridge_name='br-int',has_traffic_filtering=True,id=abc1b547-73cd-496a-95bb-8ee53d5db5d1,network=Network(4602c661-92d4-4c64-a161-c75af44a3c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc1b547-73') {{(pid=75305) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abfa5f11-79ea-5470-a360-93b040a38d83', '_type': 'linux-noop'}}, row=False) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabc1b547-73, may_exist=True, interface_attrs={}) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabc1b547-73, col_values=(('qos', UUID('e6693e76-90cf-47ef-9a67-5c4c53ee7995')),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabc1b547-73, col_values=(('external_ids', {'iface-id': 'abc1b547-73cd-496a-95bb-8ee53d5db5d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:2c:32', 'vm-uuid': '9c7b7910-7fb4-4a52-92db-7affee4b74b4'}),), if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:48 user nova-compute[75305]: INFO os_vif [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:2c:32,bridge_name='br-int',has_traffic_filtering=True,id=abc1b547-73cd-496a-95bb-8ee53d5db5d1,network=Network(4602c661-92d4-4c64-a161-c75af44a3c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc1b547-73')
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No VIF found with MAC fa:16:3e:ea:2c:32, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.network.neutron [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated VIF entry in instance network info cache for port abc1b547-73cd-496a-95bb-8ee53d5db5d1. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG nova.network.neutron [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:01:48 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-dcd67303-4e75-4edf-acf5-4885d5b602b2 req-b58c9583-2b76-4ce8-b394-ac113d2ad09c service nova] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-20450ee9-65a9-4174-a41c-cf3328db8759 req-462d24f3-caa5-4b71-bfe2-1cc69ae0be21 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-20450ee9-65a9-4174-a41c-cf3328db8759 req-462d24f3-caa5-4b71-bfe2-1cc69ae0be21 service nova] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-20450ee9-65a9-4174-a41c-cf3328db8759 req-462d24f3-caa5-4b71-bfe2-1cc69ae0be21 service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-20450ee9-65a9-4174-a41c-cf3328db8759 req-462d24f3-caa5-4b71-bfe2-1cc69ae0be21 service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:49 user nova-compute[75305]: DEBUG nova.compute.manager [req-20450ee9-65a9-4174-a41c-cf3328db8759 req-462d24f3-caa5-4b71-bfe2-1cc69ae0be21 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] No waiting events found dispatching network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:01:49 user nova-compute[75305]: WARNING nova.compute.manager [req-20450ee9-65a9-4174-a41c-cf3328db8759 req-462d24f3-caa5-4b71-bfe2-1cc69ae0be21 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received unexpected event network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 for instance with vm_state building and task_state spawning.
Nov 14 09:01:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:50 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-cc8c34fc-25c5-4fcb-8d9c-738e302f1c2e req-4a8c3fe7-28d4-45b9-811e-20ce656abb72 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc8c34fc-25c5-4fcb-8d9c-738e302f1c2e req-4a8c3fe7-28d4-45b9-811e-20ce656abb72 service nova] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc8c34fc-25c5-4fcb-8d9c-738e302f1c2e req-4a8c3fe7-28d4-45b9-811e-20ce656abb72 service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-cc8c34fc-25c5-4fcb-8d9c-738e302f1c2e req-4a8c3fe7-28d4-45b9-811e-20ce656abb72 service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.compute.manager [req-cc8c34fc-25c5-4fcb-8d9c-738e302f1c2e req-4a8c3fe7-28d4-45b9-811e-20ce656abb72 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] No waiting events found dispatching network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:01:51 user nova-compute[75305]: WARNING nova.compute.manager [req-cc8c34fc-25c5-4fcb-8d9c-738e302f1c2e req-4a8c3fe7-28d4-45b9-811e-20ce656abb72 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received unexpected event network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 for instance with vm_state building and task_state spawning.
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Instance event wait completed in 0 seconds for  {{(pid=75305) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Guest created on hypervisor {{(pid=75305) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 09:01:51 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Instance spawned successfully.
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Found default for hw_cdrom_bus of ide {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Found default for hw_disk_bus of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Found default for hw_input_bus of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Found default for hw_pointer_model of None {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Found default for hw_video_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:01:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Found default for hw_vif_model of virtio {{(pid=75305) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 09:01:52 user nova-compute[75305]: INFO nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Took 6.79 seconds to spawn the instance on the hypervisor.
Nov 14 09:01:52 user nova-compute[75305]: DEBUG nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Checking state {{(pid=75305) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 09:01:52 user nova-compute[75305]: INFO nova.compute.manager [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Took 7.40 seconds to build instance.
Nov 14 09:01:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b609d665-6c10-40a2-8cd5-3c24206c9e29 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.497s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:01:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:54 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:01:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:01:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:02:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:02:05 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:02:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:02:06 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:02:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8862MB free_disk=24.984882354736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:02:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:02:07 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:02:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:02:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:14 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:19 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:24 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:02:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:02:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:02:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:03:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:06 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:07 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:03:07 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:03:07 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=24.956348419189453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:03:07 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:03:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:03:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:03:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-changed-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG nova.compute.manager [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Refreshing instance network info cache due to event network-changed-abc1b547-73cd-496a-95bb-8ee53d5db5d1. {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Refreshing network info cache for port abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated VIF entry in instance network info cache for port abc1b547-73cd-496a-95bb-8ee53d5db5d1. {{(pid=75305) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG nova.network.neutron [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:03:35 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-bfc1c63e-ba87-4c3f-bed7-6061ee27ebae req-7c597000-2eb2-445e-8983-706f5d5f8187 service nova] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:03:38 user nova-compute[75305]: INFO nova.compute.manager [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attaching volume e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 to /dev/vdb
Nov 14 09:03:38 user nova-compute[75305]: DEBUG os_brick.utils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a28f5a-9d50-4735-812a-ea85f0eb1813]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f2d929-4068-41ee-bb47-b27851c41388]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3097f671-9fb9-4779-bb2b-6bf09efd79f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a55037-78b4-412f-acfc-c7d5c4acadc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:03:38 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:03:38 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c359c1-5cc0-4aa9-bdc5-23a142735efd]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG os_brick.utils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:03:38 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating existing volume attachment record: ebb1d20f-2015-433d-a5b5-8c94bf2069b2 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:03:39 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVYnvLAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:03:43 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:03:43 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:03:43 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9394e37c-513d-471c-b4c2-0c87501076e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:03:43 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a62f65b-d805-4195-99fe-8e474a392161]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5] added
Nov 14 09:03:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5904e4ba-00aa-4b3c-abfb-1af5e972aae6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[871705b4-1e8f-4148-a279-722b535e4def]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVYnvLAg {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CVYnvLAg" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37623f00-076c-4943-b581-fe4aba155179]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CVYnvLAg'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[37da68ef-7989-42db-89db-fff4be056b3a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[108c0636-b6d0-4281-8ab1-7d1dd78f4fca]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:03:43 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:03:43 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:03:43 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:03:43 user nova-compute[75305]: 
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[22368858-2731-48d8-a707-b416f062047b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260]
Nov 14 09:03:43 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260] successful.
Nov 14 09:03:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d464c03-6dca-4cc1-b0d0-f9c1c9af1193]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3cf345-96c9-4f35-bee1-39d5174e3bfe]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 (non-flash)
Nov 14 09:03:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 (non-flash)
Nov 14 09:03:43 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.231s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9948f4d0-6112-470f-a307-6a08bea34529]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:03:43 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVYnvLAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23835626164643537', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835626164643537', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:03:44 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:03:44 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:03:44 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:03:44 user nova-compute[75305]:   <serial>e58ce0c5-1a3d-4f17-aee3-8456b2b231b5</serial>
Nov 14 09:03:44 user nova-compute[75305]: </disk>
Nov 14 09:03:44 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No VIF found with MAC fa:16:3e:ea:2c:32, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:03:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-3abbbe22-d786-41ad-9da4-a2343a7bec5a tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.607s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:03:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:03:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:03:52 user nova-compute[75305]: INFO nova.compute.manager [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Detaching volume e58ce0c5-1a3d-4f17-aee3-8456b2b231b5
Nov 14 09:03:52 user nova-compute[75305]: INFO nova.virt.block_device [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attempting to driver detach volume e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 from mountpoint /dev/vdb
Nov 14 09:03:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Attempting to detach device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:03:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:03:52 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:03:52 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:03:52 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:03:52 user nova-compute[75305]:   <serial>e58ce0c5-1a3d-4f17-aee3-8456b2b231b5</serial>
Nov 14 09:03:52 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:03:52 user nova-compute[75305]: </disk>
Nov 14 09:03:52 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:03:52 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config.
Nov 14 09:03:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:03:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:03:52 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:03:52 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:03:52 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:03:52 user nova-compute[75305]:   <serial>e58ce0c5-1a3d-4f17-aee3-8456b2b231b5</serial>
Nov 14 09:03:52 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:03:52 user nova-compute[75305]: </disk>
Nov 14 09:03:52 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:03:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:03:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:03:55 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:03:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:04:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:09 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:04:09 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8966MB free_disk=24.955101013183594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:04:09 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:13 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 is timed out.
Nov 14 09:04:13 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config.
Nov 14 09:04:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CVYnvLAg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:04:13 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f9ffe5-9676-49ff-a64b-a1e8eb0eda1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:04:13 user nova-compute[75305]: No targets found.
Nov 14 09:04:13 user nova-compute[75305]: iSNS:
Nov 14 09:04:13 user nova-compute[75305]: No targets found.
Nov 14 09:04:13 user nova-compute[75305]: STATIC:
Nov 14 09:04:13 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5
Nov 14 09:04:13 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:04:13 user nova-compute[75305]:                 Iface Name: default
Nov 14 09:04:13 user nova-compute[75305]: FIRMWARE:
Nov 14 09:04:13 user nova-compute[75305]: No targets found.
Nov 14 09:04:13 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:04:13 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:04:13 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e714f75e-36f2-4197-b233-6704b6b98cbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[efad985d-2a97-4710-8f99-eb6518ce70a5]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 (non-flash)
Nov 14 09:04:13 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 (non-flash)
Nov 14 09:04:13 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf442c0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[be87cb9b-7e32-4164-988f-eee5da5286de]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcbc31b-0b4b-48a6-84b4-f76728c86e9d]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c0221e-bffb-49bd-8c0e-64a93ac36aac]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e2197-beb2-4e2c-9c16-7bf0da0c5399]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a82bd89-0dd3-4396-80b7-75338f5d93e8]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81ec07a-85f3-4872-a533-339ea1582cc9]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260]
Nov 14 09:04:13 user nova-compute[75305]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5, portal: 172.16.0.220,3260] successful.
Nov 14 09:04:13 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e58ce0c5-1a3d-4f17-aee3-8456b2b231b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3383adf-b9a5-4c34-9306-bd3993cc6ade]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== disconnect_volume: return (313ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:04:13 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG nova.objects.instance [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-b7da180b-b72e-45a0-924f-7f6953133e26 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.684s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:04:14 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:04:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:04:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:04:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:04:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 09:04:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] There are 0 instances to clean {{(pid=75305) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 09:04:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:23 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:27 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:27 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75305) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 09:04:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:04:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:04:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:04:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:04:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:04:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:04:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:04:44 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:04:44 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:04:44 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:04:45 user nova-compute[75305]: INFO nova.compute.manager [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attaching volume d352d7c1-cad1-4b26-b4cd-2da06635303b to /dev/vdb
Nov 14 09:04:45 user nova-compute[75305]: DEBUG os_brick.utils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e6290a-43fd-4349-85b6-d64594c26d02]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a29f7b-54d1-41d8-a775-217cecccb9ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[063747d9-d739-4b6b-8d08-512ae52f6bd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9897623e-f1bb-41f2-948e-c2189a7e6f4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:04:45 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:04:45 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f1e4b3-648e-4221-9131-558da0b6d948]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG os_brick.utils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:04:45 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating existing volume attachment record: c977df49-0287-4199-9b14-1f838ed6042c {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:04:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkmEfoDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:04:49 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:04:49 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:04:49 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864f64b-3df1-4790-8fcd-ac60f4864904]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:04:49 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7badf5a5-e509-4815-a0ba-98f4742db6a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b] added
Nov 14 09:04:49 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d5432f-2ce4-497d-be86-c891c78f5eb4]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a80351-85bc-4bcc-b8ff-c26a02c6ce4b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkmEfoDr {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xkmEfoDr" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98b96fa-9099-48a4-bce7-7848f8a73ab7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xkmEfoDr'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[679b8deb-b53b-4322-acbb-3ae33bd9c2f0]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f83dc-453f-495b-9ee9-a0a5dd8fd5dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:04:49 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:04:49 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:04:49 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:04:49 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:04:49 user nova-compute[75305]: 
Nov 14 09:04:49 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8670ce83-5e71-428f-9698-2fb0ea06be7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260]
Nov 14 09:04:50 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260] successful.
Nov 14 09:04:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75ad3ea-0eca-48ea-9498-91c3c66adbf3]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a4ad3d-da50-415c-aed6-c4aca455def5]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b (non-flash)
Nov 14 09:04:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b (non-flash)
Nov 14 09:04:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f58b18-46c3-460a-8367-094985194a20]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:04:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkmEfoDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23730353335383664', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730353335383664', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG nova.objects.instance [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:04:51 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:04:51 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:04:51 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:04:51 user nova-compute[75305]:   <serial>d352d7c1-cad1-4b26-b4cd-2da06635303b</serial>
Nov 14 09:04:51 user nova-compute[75305]: </disk>
Nov 14 09:04:51 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No VIF found with MAC fa:16:3e:ea:2c:32, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:04:51 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-a5a7d8d2-e941-4f7f-b21b-6e9c9b470bac tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.097s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:04:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:04:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:04:53 user nova-compute[75305]: INFO nova.compute.manager [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Detaching volume d352d7c1-cad1-4b26-b4cd-2da06635303b
Nov 14 09:04:53 user nova-compute[75305]: INFO nova.virt.block_device [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attempting to driver detach volume d352d7c1-cad1-4b26-b4cd-2da06635303b from mountpoint /dev/vdb
Nov 14 09:04:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Attempting to detach device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:04:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:04:53 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:04:53 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:04:53 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:04:53 user nova-compute[75305]:   <serial>d352d7c1-cad1-4b26-b4cd-2da06635303b</serial>
Nov 14 09:04:53 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:04:53 user nova-compute[75305]: </disk>
Nov 14 09:04:53 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:04:53 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config.
Nov 14 09:04:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:04:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:04:53 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:04:53 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:04:53 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:04:53 user nova-compute[75305]:   <serial>d352d7c1-cad1-4b26-b4cd-2da06635303b</serial>
Nov 14 09:04:53 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:04:53 user nova-compute[75305]: </disk>
Nov 14 09:04:53 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:04:54 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:04:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:04:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:04:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:01 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:01 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:05:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:08 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:09 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:05:09 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:05:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8953MB free_disk=24.95417022705078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:05:09 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:05:12 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:14 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 is timed out.
Nov 14 09:05:14 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config.
Nov 14 09:05:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xkmEfoDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:05:14 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a111c69-e78d-499b-b68d-80005a18ac15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:05:14 user nova-compute[75305]: No targets found.
Nov 14 09:05:14 user nova-compute[75305]: iSNS:
Nov 14 09:05:14 user nova-compute[75305]: No targets found.
Nov 14 09:05:14 user nova-compute[75305]: STATIC:
Nov 14 09:05:14 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b
Nov 14 09:05:14 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:05:14 user nova-compute[75305]:                 Iface Name: default
Nov 14 09:05:14 user nova-compute[75305]: FIRMWARE:
Nov 14 09:05:14 user nova-compute[75305]: No targets found.
Nov 14 09:05:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:05:14 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:05:14 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb68b284-7f89-40b4-9386-b20f330995c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e3afca-39f0-404e-ba67-ee9ae701ccb1]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b (non-flash)
Nov 14 09:05:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b (non-flash)
Nov 14 09:05:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf20765e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c2373-ad2a-4a15-9f5f-af7aaf691126]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4017dfea-9caa-4284-8ac8-51b2fce6faa0]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d048528-4809-49aa-8866-5818d7c7ba78]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.028s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cdbf21-033a-4947-99c5-796591b718db]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b71833d-e867-4764-962c-f54412ba7e37]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7ec3dc-7f4f-4108-a680-c20edb86ac21]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260]
Nov 14 09:05:14 user nova-compute[75305]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b, portal: 172.16.0.220,3260] successful.
Nov 14 09:05:14 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d352d7c1-cad1-4b26-b4cd-2da06635303b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1baae9-68b6-4478-a38e-b0347a59276f]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== disconnect_volume: return (270ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:05:14 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-457792ef-6e9b-4f36-b184-b470b50fac63 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.600s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:05:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:05:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:05:45 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:05:45 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:05:46 user nova-compute[75305]: INFO nova.compute.manager [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attaching volume a2e393c3-da65-4b3c-9bc1-15fed92a03cf to /dev/vdb
Nov 14 09:05:46 user nova-compute[75305]: DEBUG os_brick.utils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c745c69-b495-4764-988a-66c9029676fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6bdfbf-b46d-423a-bb01-300cb6aba3f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[04874401-c1b3-4c2a-adb8-9d93d3f8c484]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb0c52a-dcab-4777-9dee-702023f6a170]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:05:46 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:05:46 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c957934-6c1d-403f-9da1-f94e7115c666]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG os_brick.utils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:05:46 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating existing volume attachment record: 8e099178-db54-484b-81c7-5f739a05c2b7 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:05:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:05:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgFUdjRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:05:50 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:05:50 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:05:50 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f7049-d8ea-4665-bcc7-a11051f143c4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:05:50 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23f53e-2d83-47aa-b154-b5db5772b5e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf] added
Nov 14 09:05:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a4a91e-9927-4ccc-a74f-eed922646b9c]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.105s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[819cac98-61a9-461f-b3ee-2686dadd7b89]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgFUdjRC {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgFUdjRC" returned: 0 in 0.023s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecf1673-fa8d-4841-935c-fcc34fb1a3d7]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lgFUdjRC'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53bd4a1-71b4-4e10-88d9-9aff3be1bac6]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfdef6b-5477-4ae0-9588-37dbc38197e5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:05:50 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:05:50 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:05:50 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:05:50 user nova-compute[75305]: 
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[391f7beb-4034-4b10-86a1-f72ddf146866]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260]
Nov 14 09:05:50 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260] successful.
Nov 14 09:05:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b48bcbf-cdb3-4d9a-929e-9723f1e45f24]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ac5815-5d73-4d5c-ab4d-9a3139f56cd4]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf (non-flash)
Nov 14 09:05:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf (non-flash)
Nov 14 09:05:50 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f822ade-b719-4222-be38-9594d44aeaaa]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:05:50 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgFUdjRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:05:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:05:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23562643135363733', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:05:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562643135363733', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:05:51 user nova-compute[75305]: DEBUG nova.objects.instance [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:05:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:05:51 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:05:51 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:05:51 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:05:51 user nova-compute[75305]:   <serial>a2e393c3-da65-4b3c-9bc1-15fed92a03cf</serial>
Nov 14 09:05:51 user nova-compute[75305]: </disk>
Nov 14 09:05:51 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:05:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:05:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:05:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No VIF found with MAC fa:16:3e:ea:2c:32, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:05:52 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-2a9e3a0b-70d1-4ed7-a322-e246e565b8f8 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.379s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:05:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:05:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:05:55 user nova-compute[75305]: INFO nova.compute.manager [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Detaching volume a2e393c3-da65-4b3c-9bc1-15fed92a03cf
Nov 14 09:05:55 user nova-compute[75305]: INFO nova.virt.block_device [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attempting to driver detach volume a2e393c3-da65-4b3c-9bc1-15fed92a03cf from mountpoint /dev/vdb
Nov 14 09:05:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Attempting to detach device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:05:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:05:55 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:05:55 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:05:55 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:05:55 user nova-compute[75305]:   <serial>a2e393c3-da65-4b3c-9bc1-15fed92a03cf</serial>
Nov 14 09:05:55 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:05:55 user nova-compute[75305]: </disk>
Nov 14 09:05:55 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:05:55 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config.
Nov 14 09:05:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:05:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:05:55 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:05:55 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:05:55 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:05:55 user nova-compute[75305]:   <serial>a2e393c3-da65-4b3c-9bc1-15fed92a03cf</serial>
Nov 14 09:05:55 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:05:55 user nova-compute[75305]: </disk>
Nov 14 09:05:55 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:05:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:05:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:05:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:05:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:03 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:03 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:06:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:10 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:11 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:06:11 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:06:11 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8945MB free_disk=24.945388793945312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:06:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:06:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:06:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 is timed out.
Nov 14 09:06:15 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config.
Nov 14 09:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgFUdjRC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:06:15 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e62abb-9f38-4fec-a82e-84e21dcafd05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:06:15 user nova-compute[75305]: No targets found.
Nov 14 09:06:15 user nova-compute[75305]: iSNS:
Nov 14 09:06:15 user nova-compute[75305]: No targets found.
Nov 14 09:06:15 user nova-compute[75305]: STATIC:
Nov 14 09:06:15 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf
Nov 14 09:06:15 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:06:15 user nova-compute[75305]:                 Iface Name: default
Nov 14 09:06:15 user nova-compute[75305]: FIRMWARE:
Nov 14 09:06:15 user nova-compute[75305]: No targets found.
Nov 14 09:06:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:06:15 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:06:15 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc1e5f-e963-46d9-a54e-306010a0d7e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6117ec7-a419-4c15-908b-34fec48ca106]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf (non-flash)
Nov 14 09:06:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf (non-flash)
Nov 14 09:06:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf20765c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b459ca6-f375-4986-b4c4-4b0c23577717]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[25435a8e-3205-4b7f-9951-2c2d657675ce]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[9775eca4-96f9-4385-b8b9-1d955228f31a]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c3ad5-1d0b-4e89-b43e-81707d486415]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[243872ea-2b04-4e2d-9ef7-3fac56244d1b]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c6f4fc-8a28-459b-9c97-615c014da13d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260]
Nov 14 09:06:15 user nova-compute[75305]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf, portal: 172.16.0.220,3260] successful.
Nov 14 09:06:15 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2e393c3-da65-4b3c-9bc1-15fed92a03cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3200189-1273-422e-93f1-2a432a1423c9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== disconnect_volume: return (286ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:06:15 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG nova.objects.instance [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:06:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-8f114ccf-e690-4466-8b5c-ee44cc477415 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.576s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:06:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:06:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:06:47 user nova-compute[75305]: INFO nova.compute.manager [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attaching volume 576a67cb-fd01-4617-89d2-c0ba289fda1d to /dev/vdb
Nov 14 09:06:47 user nova-compute[75305]: DEBUG os_brick.utils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdcf3240-ca7c-453d-822c-364c19557363]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:af646d48dd62\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c564f64e-cd9b-464d-b239-8b4f18500a71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52c52ff-07f6-4367-88cc-c3c3ca0be848]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec976a4-81cc-4383-99b1-9916bb5551d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Running cmd (subprocess): nvme version {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] 'nvme version' failed. Not Retrying. {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] nvme not present on system {{(pid=75305) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 09:06:47 user nova-compute[75305]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 09:06:47 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d333c-96de-452f-a94a-063c550f608e]: (4, '') {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75305) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.lightos [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] LIGHTOS: no hostnqn found. {{(pid=75305) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG os_brick.utils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:af646d48dd62', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:06:47 user nova-compute[75305]: DEBUG nova.virt.block_device [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating existing volume attachment record: f07e7d84-0c3e-44e8-9c30-541ffe46a237 {{(pid=75305) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 09:06:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Calling os-brick to attach iSCSI Volume {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptKWZmwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:06:51 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:06:51 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:06:51 user nova-compute[75305]: INFO os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc83ee2e-265a-4a8d-b615-dac6515535a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 09:06:51 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --interface default --op new {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c291585c-622e-489f-9803-dde84436fe31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d] added\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d] added
Nov 14 09:06:51 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c098ebb-e87f-4a2e-9667-2bdbfd663ac1]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad00071a-8944-4c3e-b4e2-3ed2114180ab]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptKWZmwa {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptKWZmwa" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[834fa9bb-c51b-41da-81f5-37af3171f3de]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ptKWZmwa'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[18532576-2794-4f19-9d82-6ed40f28b275]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[805b93d5-0967-44bb-a5cb-894cddad4247]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:06:51 user nova-compute[75305]:  {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 09:06:51 user nova-compute[75305]:  {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:06:51 user nova-compute[75305]: WARNING os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 09:06:51 user nova-compute[75305]: 
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --login {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[e355a235-661d-4f64-9b91-bbd438ddd59d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260]
Nov 14 09:06:51 user nova-compute[75305]: Login to [iface: default, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260] successful.
Nov 14 09:06:51 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e5e05e-2b42-4a1c-996a-ebdf4a699fcf]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a3a619-e558-4c35-8f2b-5f12c3bde2b9]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d (non-flash)
Nov 14 09:06:51 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d (non-flash)
Nov 14 09:06:51 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to 172.16.0.220:3260 {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75305) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75305) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[5471def3-996d-48f0-883d-4ed795615d5e]: (4, ('- - 0', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:06:51 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:06:52 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75305) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 09:06:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptKWZmwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75305) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 09:06:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:06:52 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23765326161383031', 'path': '/dev/sdb'} {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:06:52 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765326161383031', 'path': '/dev/sdb'} {{(pid=75305) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 09:06:53 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:06:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 09:06:53 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:06:53 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:06:53 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:06:53 user nova-compute[75305]:   <serial>576a67cb-fd01-4617-89d2-c0ba289fda1d</serial>
Nov 14 09:06:53 user nova-compute[75305]: </disk>
Nov 14 09:06:53 user nova-compute[75305]:  {{(pid=75305) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 09:06:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:06:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75305) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 09:06:53 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] No VIF found with MAC fa:16:3e:ea:2c:32, not building metadata {{(pid=75305) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 09:06:53 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e1455ff5-ad00-4eec-b9a2-d1031c23200e tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.170s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:06:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:06:55 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:06:55 user nova-compute[75305]: INFO nova.compute.manager [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Detaching volume 576a67cb-fd01-4617-89d2-c0ba289fda1d
Nov 14 09:06:55 user nova-compute[75305]: INFO nova.virt.block_device [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Attempting to driver detach volume 576a67cb-fd01-4617-89d2-c0ba289fda1d from mountpoint /dev/vdb
Nov 14 09:06:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Attempting to detach device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config. {{(pid=75305) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 09:06:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:06:55 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:06:55 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:06:55 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:06:55 user nova-compute[75305]:   <serial>576a67cb-fd01-4617-89d2-c0ba289fda1d</serial>
Nov 14 09:06:55 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:06:55 user nova-compute[75305]: </disk>
Nov 14 09:06:55 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:06:55 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the persistent domain config.
Nov 14 09:06:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config. {{(pid=75305) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 09:06:55 user nova-compute[75305]: DEBUG nova.virt.libvirt.guest [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 09:06:55 user nova-compute[75305]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 09:06:55 user nova-compute[75305]:   <source dev="/dev/sdb"/>
Nov 14 09:06:55 user nova-compute[75305]:   <target dev="vdb" bus="virtio"/>
Nov 14 09:06:55 user nova-compute[75305]:   <serial>576a67cb-fd01-4617-89d2-c0ba289fda1d</serial>
Nov 14 09:06:55 user nova-compute[75305]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 09:06:55 user nova-compute[75305]: </disk>
Nov 14 09:06:55 user nova-compute[75305]:  {{(pid=75305) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 09:06:56 user nova-compute[75305]: DEBUG nova.virt.libvirt.driver [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 09:06:56 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:06:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:06:59 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:07:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:08 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:11 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75305) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:12 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:07:12 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:07:12 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=24.94443130493164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75305) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:07:12 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:07:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:07:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:16 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 is timed out.
Nov 14 09:07:16 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully detached device vdb from instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4 from the live domain config.
Nov 14 09:07:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] calling os-brick to detach iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcf5c15b070>, {'target_iqn': 'iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptKWZmwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 09:07:16 user nova-compute[75305]: WARNING os_brick.initiator.connectors.base [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[4023d059-73bb-41f1-a92c-f95e7fd73d07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 09:07:16 user nova-compute[75305]: No targets found.
Nov 14 09:07:16 user nova-compute[75305]: iSNS:
Nov 14 09:07:16 user nova-compute[75305]: No targets found.
Nov 14 09:07:16 user nova-compute[75305]: STATIC:
Nov 14 09:07:16 user nova-compute[75305]: Target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d
Nov 14 09:07:16 user nova-compute[75305]:         Portal: 172.16.0.220:3260,-1
Nov 14 09:07:16 user nova-compute[75305]:                 Iface Name: default
Nov 14 09:07:16 user nova-compute[75305]: FIRMWARE:
Nov 14 09:07:16 user nova-compute[75305]: No targets found.
Nov 14 09:07:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 09:07:16 user nova-compute[75305]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 09:07:16 user nova-compute[75305]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75305) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d', 0)] {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3074205-8f85-4e09-8c6e-1608976daff3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[86be7cf5-5567-4624-8d95-2188a2c78281]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d (non-flash)\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d (non-flash)
Nov 14 09:07:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d (non-flash)
Nov 14 09:07:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcf542ab520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d'): ({'sdb'}, set())}) {{(pid=75305) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Removing single pathed devices sdb {{(pid=75305) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb35f054-a027-4458-ace7-57cfb6a68607]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f2423-a736-4422-8187-0b51f5f34f4b]: (4, ('ok\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Flushing IO for device /dev/sdb {{(pid=75305) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaf68b6-b228-4795-bf77-1fc0138201a9]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75305) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6442e8a-80a1-4b93-9b78-f044f99537c4]: (4, ('1', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.linuxscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] SCSI volumes sdb have been removed. {{(pid=75305) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d')] {{(pid=75305) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8f2fe7-49cf-4674-b10d-bd82f389c105]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --logout {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ede2914-1046-4152-ade5-963a39674812]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260]
Nov 14 09:07:16 user nova-compute[75305]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d, portal: 172.16.0.220,3260] successful.
Nov 14 09:07:16 user nova-compute[75305]:  stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op delete {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:576a67cb-fd01-4617-89d2-c0ba289fda1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86224) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG oslo.privsep.daemon [-] privsep: reply[b772e8d0-9713-401c-9e3c-1e43d1a948fb]: (4, ('', '')) {{(pid=86224) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75305) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.base [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] <== disconnect_volume: return (271ms) None {{(pid=75305) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 09:07:16 user nova-compute[75305]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Disconnected iSCSI Volume {{(pid=75305) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG nova.objects.instance [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'flavor' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-6f2a3e21-a3bd-4b1d-95ba-86689ab5205c tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquired lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Forcefully refreshing network info cache for instance {{(pid=75305) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG nova.objects.instance [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lazy-loading 'info_cache' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG nova.network.neutron [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [{"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Releasing lock "refresh_cache-9c7b7910-7fb4-4a52-92db-7affee4b74b4" {{(pid=75305) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updated the network info_cache for instance {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 09:07:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:07:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:07:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:07:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:07:57 user nova-compute[75305]: INFO nova.compute.manager [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Terminating instance
Nov 14 09:07:57 user nova-compute[75305]: DEBUG nova.compute.manager [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Start destroying the instance on the hypervisor. {{(pid=75305) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:57 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-44b360bb-df13-49cc-896f-f07947573f3c req-59b414c1-dc89-4848-b5b7-cba897ff30eb service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-vif-unplugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44b360bb-df13-49cc-896f-f07947573f3c req-59b414c1-dc89-4848-b5b7-cba897ff30eb service nova] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44b360bb-df13-49cc-896f-f07947573f3c req-59b414c1-dc89-4848-b5b7-cba897ff30eb service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-44b360bb-df13-49cc-896f-f07947573f3c req-59b414c1-dc89-4848-b5b7-cba897ff30eb service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-44b360bb-df13-49cc-896f-f07947573f3c req-59b414c1-dc89-4848-b5b7-cba897ff30eb service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] No waiting events found dispatching network-vif-unplugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [req-44b360bb-df13-49cc-896f-f07947573f3c req-59b414c1-dc89-4848-b5b7-cba897ff30eb service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-vif-unplugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 for instance with task_state deleting. {{(pid=75305) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [-] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Instance destroyed successfully.
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.objects.instance [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lazy-loading 'resources' on Instance uuid 9c7b7910-7fb4-4a52-92db-7affee4b74b4 {{(pid=75305) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.virt.libvirt.vif [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T09:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1109773725',display_name='tempest-SnapshotDataIntegrityTests-server-1109773725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1109773725',id=53,image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLypDeuyupnqu2uQLgMJsYdt3dNFC5znFE/zGjTUPfKXjhHb/rrDIfWJ6OwMFL2bbB7P64L/AXUWUrLaB7NG18V3nDvA1KsAmp+EuNpH7D58D7ruAe0d0N2FlJ6bbq/TwQ==',key_name='tempest-keypair-250085567',keypairs=<?>,launch_index=0,launched_at=2023-11-14T09:01:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f6e52babe9498c98347d3d17afe35f',ramdisk_id='',reservation_id='r-b4zriffg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5d88aadf-7386-48ab-8524-9b99a75f107c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-135103649',owner_user_name='tempest-SnapshotDataIntegrityTests-135103649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T09:01:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68d91a91cc5443d8ad4238d063b958c8',uuid=9c7b7910-7fb4-4a52-92db-7affee4b74b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Converting VIF {"id": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "address": "fa:16:3e:ea:2c:32", "network": {"id": "4602c661-92d4-4c64-a161-c75af44a3c4a", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-275745451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05f6e52babe9498c98347d3d17afe35f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabc1b547-73", "ovs_interfaceid": "abc1b547-73cd-496a-95bb-8ee53d5db5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.network.os_vif_util [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:2c:32,bridge_name='br-int',has_traffic_filtering=True,id=abc1b547-73cd-496a-95bb-8ee53d5db5d1,network=Network(4602c661-92d4-4c64-a161-c75af44a3c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc1b547-73') {{(pid=75305) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG os_vif [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:2c:32,bridge_name='br-int',has_traffic_filtering=True,id=abc1b547-73cd-496a-95bb-8ee53d5db5d1,network=Network(4602c661-92d4-4c64-a161-c75af44a3c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc1b547-73') {{(pid=75305) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabc1b547-73, bridge=br-int, if_exists=True) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6693e76-90cf-47ef-9a67-5c4c53ee7995) {{(pid=75305) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:07:58 user nova-compute[75305]: INFO os_vif [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:2c:32,bridge_name='br-int',has_traffic_filtering=True,id=abc1b547-73cd-496a-95bb-8ee53d5db5d1,network=Network(4602c661-92d4-4c64-a161-c75af44a3c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabc1b547-73')
Nov 14 09:07:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Deleting instance files /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4_del
Nov 14 09:07:58 user nova-compute[75305]: INFO nova.virt.libvirt.driver [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Deletion of /opt/stack/data/nova/instances/9c7b7910-7fb4-4a52-92db-7affee4b74b4_del complete
Nov 14 09:07:58 user nova-compute[75305]: INFO nova.compute.manager [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 09:07:58 user nova-compute[75305]: DEBUG oslo.service.loopingcall [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75305) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.compute.manager [-] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Deallocating network for instance {{(pid=75305) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] deallocate_for_instance() {{(pid=75305) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 09:07:58 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:07:59 user nova-compute[75305]: DEBUG nova.network.neutron [-] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Updating instance_info_cache with network_info: [] {{(pid=75305) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 09:07:59 user nova-compute[75305]: INFO nova.compute.manager [-] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Took 1.20 seconds to deallocate network for instance.
Nov 14 09:07:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:07:59 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:08:00 user nova-compute[75305]: INFO nova.scheduler.client.report [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Deleted allocations for instance 9c7b7910-7fb4-4a52-92db-7affee4b74b4
Nov 14 09:08:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3673f0b-a193-4b76-9ea6-20b94c694025 req-684a6cdf-17e4-46c2-a962-34cf53eebf7f service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3673f0b-a193-4b76-9ea6-20b94c694025 req-684a6cdf-17e4-46c2-a962-34cf53eebf7f service nova] Acquiring lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3673f0b-a193-4b76-9ea6-20b94c694025 req-684a6cdf-17e4-46c2-a962-34cf53eebf7f service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [req-b3673f0b-a193-4b76-9ea6-20b94c694025 req-684a6cdf-17e4-46c2-a962-34cf53eebf7f service nova] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3673f0b-a193-4b76-9ea6-20b94c694025 req-684a6cdf-17e4-46c2-a962-34cf53eebf7f service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] No waiting events found dispatching network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 09:08:00 user nova-compute[75305]: WARNING nova.compute.manager [req-b3673f0b-a193-4b76-9ea6-20b94c694025 req-684a6cdf-17e4-46c2-a962-34cf53eebf7f service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received unexpected event network-vif-plugged-abc1b547-73cd-496a-95bb-8ee53d5db5d1 for instance with vm_state deleted and task_state None.
Nov 14 09:08:00 user nova-compute[75305]: DEBUG nova.compute.manager [req-b3673f0b-a193-4b76-9ea6-20b94c694025 req-684a6cdf-17e4-46c2-a962-34cf53eebf7f service nova] [instance: 9c7b7910-7fb4-4a52-92db-7affee4b74b4] Received event network-vif-deleted-abc1b547-73cd-496a-95bb-8ee53d5db5d1 {{(pid=75305) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 09:08:00 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-4c87f15f-5a4d-4a6f-ad41-e1a1f45858f0 tempest-SnapshotDataIntegrityTests-135103649 tempest-SnapshotDataIntegrityTests-135103649-project-member] Lock "9c7b7910-7fb4-4a52-92db-7affee4b74b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.417s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:08:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:04 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:04 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:08:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:08:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:08:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:08:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:08:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:10 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:13 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:08:13 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:08:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9076MB free_disk=24.971519470214844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:08:13 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:08:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:17 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:18 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:18 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:08:19 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Starting heal instance info cache {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 09:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Rebuilding the list of instances to heal {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 09:08:19 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Didn't find any instances for network info cache update. {{(pid=75305) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 09:08:23 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:28 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:08:33 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:38 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:08:43 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:08:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:08:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75305) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 09:08:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:08:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75305) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 09:08:48 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:49 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:51 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:53 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:54 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:08:58 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 09:09:00 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:09:03 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:09:05 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:09:05 user nova-compute[75305]: DEBUG nova.compute.manager [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75305) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 09:09:08 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:09:11 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:09:13 user nova-compute[75305]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75305) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG oslo_service.periodic_task [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75305) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75305) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 09:09:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:09:15 user nova-compute[75305]: WARNING nova.virt.libvirt.driver [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 09:09:15 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Hypervisor/Node resource view: name=user free_ram=9211MB free_disk=24.9312744140625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75305) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75305) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing inventories for resource provider b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating ProviderTree inventory for provider b140deac-8ace-4c60-902f-ce7a9011677b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 09:09:15 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Updating inventory in ProviderTree for provider b140deac-8ace-4c60-902f-ce7a9011677b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 09:09:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing aggregate associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, aggregates: None {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 09:09:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Refreshing trait associations for resource provider b140deac-8ace-4c60-902f-ce7a9011677b, traits: COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_RESCUE_BFV,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_MMX,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75305) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 09:09:16 user nova-compute[75305]: DEBUG nova.compute.provider_tree [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed in ProviderTree for provider: b140deac-8ace-4c60-902f-ce7a9011677b {{(pid=75305) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 09:09:16 user nova-compute[75305]: DEBUG nova.scheduler.client.report [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Inventory has not changed for provider b140deac-8ace-4c60-902f-ce7a9011677b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75305) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 09:09:16 user nova-compute[75305]: DEBUG nova.compute.resource_tracker [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Compute_service record updated for user:user {{(pid=75305) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 09:09:16 user nova-compute[75305]: DEBUG oslo_concurrency.lockutils [None req-e2593715-77c7-4f37-92dc-0ba67c59add8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=75305) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}